Spark, Hadoop, Kubernetes and Resource Allocation Algorithms' Optimization in Cloud Computing

The diagram of existed resource allocation algorithms technology in Cloud Computing

This course provides a comprehensive overview of cutting-edge technologies and methods in big data processing, container orchestration, and cloud computing resource management. It includes hands-on labs and a research component focused on the following key areas:

  • Apache Spark Lab: Students will engage with Spark’s powerful data processing capabilities, learning how to execute streaming and batch processing tasks efficiently.
  • Apache Hadoop Lab: The course will cover Hadoop’s foundational framework for distributed storage and big data processing, with practical exercises in the HDFS and MapReduce.
  • Kubernetes Lab: Participants will explore Kubernetes’ container orchestration mechanisms, gaining experience in deploying and managing scalable applications.
  • Resource Allocation Optimization Research: The course will delve into the theory and practice of optimizing resource allocation algorithms in cloud computing, with a research paper where students will analyze existing algorithms and propose innovative solutions.
Hin Chi Kwok
Hin Chi Kwok
Student in IEOR and Computing

I strongly believe that the 3Cs - CURIOSITY, CHALLENGE, and CHANGE - will shape my future, help me achieve my goals, and positively impact my community. I am passionate for technology, and I am here to share my journey of rediscovering my passion for STEM. Despite facing gender stereotypes and societal expectations from selecting IT as my career before, I pursue my CURIOSITY and participate in research projects and competitions. I embrace CHALLENGES, seek innovative solutions, and am actively involved in academic exchanges and entrepreneurship. My ultimate ambition is to translate my research into real products, contribute to make CHANGES in the science and technology industry, and inspire others to pursue a career in STEM.