SEN – Scheduler Enhanced Yet Another Scheduler for Cloud

SEN – Scheduler Enhanced
Yet Another Scheduler for Cloud Environments
Pursuit of “Happiness”
- Nowadays -
The Price
Scheduling the Cloud
To be considered
• Data Center Locations:
• Different cities, different continents
• Network conditions:
• Contracts
• Lawful requirements
• Infrastructure
• High Availability
• Performance
• Budget
• Cloud enabled stuff
• Market competitions
•…
May the force be with you!
The Toolbox
• KVM
• Nova
• Ceilometer
• Live migration
• Python
• Hardware sleep functionality
• Hardware wake-up functionality
Building a Scheduler
• Multiple cloud platforms
• Open source
• Pluggable algorithms
• Extensible
State of Sen
• Extensible framework is implemented.
• Deployed on 9 physical machines.
• Tested with various load scenarios.
• Anton Beloglazov’s “Openstack Neat” is
implemented.
• Round robin is implemented.
• Migration monitor is implemented.
Other Schedulers vs Sen
• Anton Beloglazov (OpenStack Neat)
•
•
•
•
•
•
•
•
Machine learning: N/A
Algorithm choice: N/A
Auto switch on/off machines: Available
Best Machine Selection: N/A
Migration Support Matrix: N/A
Supported Env: Openstack
Best fit decreasing alg.: Available
Storage Migration Support: N/A
• Watcher
•
•
•
•
•
•
•
•
Machine learning: designed
Algorithm choice: Available
Auto switch on/off machines: Planned
Best Machine Selection: N/A
Migration Support Matrix: N/A
Supported Env: Openstack
Best fit decreasing alg.: N/A
Storage Migration Support: N/A
• SEN
•
•
•
•
•
•
•
•
Machine learning: Planned
Algorithm choice: Available
Auto switch on/off machines: Available
Best Machine Selection: Available
Migration Support Matrix: Available
Supported Env: Openstack, Cloudstack(planned)
Best fit decreasing alg.: Available
Storage Migration Support: Planned
Why another scheduler?
• Loosely coupled design to enable different
cloud environments.
• To encourage new algorithms to be
implemented.
• To attract Big Brothers’ attention to supply
their adapters (input handlers/output
handlers) to Sen.
Linux distributions Timeline: Konimex, A. Lundqvist, D. Rodic
Next Steps
• Forecasting the future: Machine Learning
• Estimating user characteristics
• Estimating VM characteristics
• Other Cloud adapters:
• Apache CloudStack
•…
• Disk scheduling:
• Hadoop disk scheduler
• OpenStack Cinder scheduling
Sen Team
• Project Manager:
• Özleyiş BAYOĞLU
• Team Members:
• Canan GİRGİN
• Esra ÇELİK
• Hayati GÖNÜLTAŞ
• Selim ÖZCAN
Q&A
Digital Art Credits
•
•
•
•
•
•
•
•
•
•
Paul, https://flic.kr/p/9KkrpU, CC BY-NC-ND 2.0
Berkeley Lab, https://flic.kr/p/7kpiqx, CC BY 2.0
Eduardo Diez Viñuela, https://flic.kr/p/9PmF6j, CC BY-SA 2.0
Open Grid Scheduler / Grid Engine, https://flic.kr/p/xzEadt, CC0 1.0
Norlando Pobre, https://flic.kr/p/dRCJAZ, CC BY 2.0
Robert Hutton, https://flic.kr/p/dHxoQx, CC BY-NC-SA 2.0
ralphbijker, https://flic.kr/p/4WHXzW, CC BY 2.0
Deren, https://flic.kr/p/m1aJ5, CC BY 2.0
Electric-Eye, https://flic.kr/p/7bfimU, CC BY 2.0
VFS Digital Design, https://flic.kr/p/9dTsfj, CC BY 2.0
• Hash Milhan, https://flic.kr/p/2HLabP, CC BY 2.0
• Paul Papadimitriou, https://flic.kr/p/9BMZ8s, CC BY 2.0
• Doug Shaw, https://flic.kr/p/o97iFh, CC BY-SA 2.0