In this News and Views episode, Phil Ewels and Chris Hakkaart talk to Seqera software engineer Ben Sherman about what’s going on “under the hood” with Nextflow. We touch on task provenance, cloud cache databases and task / sub-workflow grouping. Gotta cache ‘em all!

Nextflow runtime

We covered the following topics in this episode:

• Task provenance
  • Discussion topic on the Nextflow GitHub repo
  • Pull-request #3802 to add a task-graph
  • Related:
    • Bruno Grande’s Nextflow plugin, nf-prov
    • Quilt Data plugin: nf-quilt
    • Summit 2022 recap blog post and hackathon recap talk.
• Cloud cache database
  • Pull-request #4097 to add support for cloud-based cache directories
• Task and sub-workflow grouping
  • Issue #2527 on the Nextflow repo
  • Draft PR #3909 to add Task Grouping.

Upcoming events

• Nextflow Summit 2023 in Barcelona (October 16-20) and in Boston (November 28-30).
  • Call for abstracts is currently open, just! Get them in quick!
• Two community training events are open for registration:
  • Foundational training - September 6-8, 2023
  • Advanced training - September 27-28, 2023