DataSpaces Research
202501101535
Status: #idea
Tags: DataSpaces
DataSpaces Research
ActiveSpaces
- Allows application developers to programatically define data-processing routines and dynamically deploy and execute them in the staging area at runtime, instead of moving the data to the processing codes
- QUESTION: Doesn’t workflows defined in the DAG already address this issue?
- Q: Doesn’t the scheduler already try to ensure data locality when scheduling?
- Q: Since, the kernel needs to be linked with the application code, what is the application developer doing at runtime?
- Q: When do you not know the next processing step for the data?