-
Notifications
You must be signed in to change notification settings - Fork 1
Expand file tree
/
Copy pathCITATION.CFF
More file actions
52 lines (47 loc) · 2.18 KB
/
Copy pathCITATION.CFF
File metadata and controls
52 lines (47 loc) · 2.18 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
abstract: '<p><strong>damast</strong> is an open-source Python package designed for
building, executing, and tracking reproducible data processing pipelines. </p>
<p>Scientific reproducibility and rigorous data provenance remain persistent challenges
in modern data-driven research. <br>The <em>damast</em> library contributes a
lightweight, declarative framework for structuring complex data workflows as Directed
Acyclic Graphs (DAGs) - currently focused on tabular data. damast associated datasets
with an explicit metadata specification and facilitates annotation, inspection,
filtering and rerunning of processing pipelines.</p>
<p>Individual processing steps strictly define their inputs, outputs, and parameters,
e.g., being able to enforce units, representation_types and ranges.<br>For its implementation
builds <em>damast</em> on polars library for the data processing. Using polars LazyFrame
concept, damast avoids redundant computations while guaranteeing that downstream
artifacts remain strictly synchronized with raw data inputs.<br><em>damast</em>
bridges the gap between ad-hoc script execution and heavy enterprise orchestrators,
offering researchers a lightweight, locally application, code-first solution to
ensure full reproducibility in scientific data processing pipelines.</p>
<p> </p>'
authors:
- affiliation: Simula Research Laboratory
family-names: Roehr
given-names: Thomas M.
orcid: 0000-0002-7715-7052
- affiliation: Simula Research Laboratory
family-names: Dokken
given-names: "J\xF8rgen Schartum"
orcid: 0000-0001-6489-8858
- affiliation: Simula Research Laboratory
family-names: Fouilloux
given-names: Anne
orcid: 0000-0002-1784-2920
cff-version: 1.2.0
date-released: '2026-09-04'
doi: 10.5281/zenodo.22312820
keywords:
- euroscivoc:47
- Computer and information sciences
- euroscivoc:941
- Data processing
- mesh:D015203
- Reproducibility of Results
license:
- bsd-3-clause
license-url: https://github.com/simula/damast/blob/main/LICENSE
message: If you use this software, please cite it using the metadata from this file.
title: 'damast: Creation of reproducible data processing pipelines'
type: software
version: 0.3.5