In a 'pool' with a lot of cpus ,jobs(processes) are running(lots of them) .
Given I have time/resource usage 'samples' from many prior/still running jobs - how would you go about trying to predict the process resource usage ?
Very abstractly , what I think should be done is as follows :
1) New job is submitted and start running and I wait for some time to gather resource usage information/samples
2) find a subset of jobs that their 'behave' (up until that point in running time) 'similarly' - how would u do that ? maybe those who are always in a specific margin and also there average distance is closest ?
3) choose one job from the subset I found at stage 2, and give prediction of resource usage based upon that job..
Are there known/standard way for my objective ? Would love to hear your ideas,direction etc ..