Should allow us to start pipelines for scraping and processing.

Should display the status of started pipelines

Should show us the results each step generated

Should allow us to restart/skip steps

Dashboard

Dashboard should give a quick overview of number of running pipelines and created schedules

Running pipelines should be quickly accessible

Schedules should be displayed and status of latest associated pipelines displayed

Pipeline Framework

Pipelines should be accessible in a table, with sort and filter options available

For every pipeline a detail view should exists, to inspect every step by its events and result

Scraper/Transformer API

Scraper and Transformer pipelines should be separated

Both subpages for Scraper and Transformer should use the same views for the created pipelines and schedules