Providing deep learning models as webservices

Description:
Setting up a webservice with a machine learning pipelines in the backend to let users/customers/project partners:

  • Manage Datasets, Annotations and Models
  • Execution of Machine Learning Applications, Training and Inference
  • Access to high-performance compute cluster via simple user interface
  • Annotation integration

Links:
None

Keywords:
machine learning pipelines, workflows, datastorage

Motivation:
Combination of software architecture, microservices and tools to use when creating ML pipelines

Requirements/Prerequisities:
docker, kubernetes, airflow, minio

Level:
concret: specific best practice (e.g. use microservice)

Application domain:
Data science (analysis & visualisation), Software engineering

Main phase:
Data Science: Preparation/Integration, Data Science: Modeling/Training/Evaluation, Development: Implementation/Code/Build, Development: Testing

Related literature:
https://airflow.apache.org;
https://kubernetes.io;
https://www.docker.com/
https://min.io

In which projects do/did you use this practice?
S3AI, FlexSpect,...

Researcher

0–2 years of experiences
Software Competence Center Hagenberg

1. How do ​you rate the potential benefit for your projects? 5
2. How often are you using that practice? 4
3. What is the effort to introduce the practice in your project upfront? 3
4. What is the effort to apply the best practice in your project daily basis? 3

Questions 1, 3 and 4 (1 = Low, 5 = High)
Question 2 (1 = Never, 5 = Always)

You are running an old browser version. We recommend updating your browser to its latest version.

More info