202501101535
Status: #idea
Tags: DataSpaces

DataSpaces Research

ActiveSpaces

• Allows application developers to programatically define data-processing routines and dynamically deploy and execute them in the staging area at runtime, instead of moving the data to the processing codes
  • QUESTION: Doesn’t workflows defined in the DAG already address this issue?
  • Q: Doesn’t the scheduler already try to ensure data locality when scheduling?
  • Q: Since, the kernel needs to be linked with the application code, what is the application developer doing at runtime?
  • Q: When do you not know the next processing step for the data?

References