Research

September 24, 2024

Smart mobility is a wide umbrella for different systems and services to meet various end-user needs without compromising the collective good of the society and the environment. These systems and services are built on advanced technologies such as assisted and automated driving, connectivity, and electrification, alongside innovative business models like the digital economy, servitization, the sharing economy, the gig economy, the experience economy, and the circular economy.

Truly intelligent systems and services should integrate situation awareness, automation, and optimization. Situation awareness enables a comprehensive understanding of the current state of a system and its environment. Without the ability to monitor and observe the system, projecting its state or performance becomes challenging, which in turn makes it difficult to control. And without control, we cannot make the necessary adjustments to optimize the system.


My current research focuses on situation awareness (including perception, comprehension, and projection), automation (covering both physical and digital process automation), and optimization (spanning strategic, tactical, and operational levels) as foundational and complementary aspects of smart mobility systems and services. Additionally, I explore the sustainability aspects of both existing and emerging smart mobility technologies and business models.

My specific research interests within these three facets of smart mobility systems and services include:

Situation Awareness:
  • Inclement weather perception
  • Vulnerable road user (VRU) intent prediction
  • Driver and occupant monitoring systems
  • Software-defined vehicle (SDV) observability
  • Contextual root cause analysis
  • Digital twins in mobility systems
  • Spatiotemporal data analytics
Automation:
  • Assisted driving systems
  • Self-driving technology for urban mobility, agriculture, construction, and mining
  • Adaptive traffic signal control
  • Teleoperated driving
  • Large Language Model (LLM)-based chatbot and question-and-answer (Q&A) engines
  • Large Action Models
Optimization:
  • Multi-criteria routing
  • Optimal assignment in transportation systems
  • Optimal deployment of mobile assets in transportation networks
  • Dynamic pricing
  • Smart parking systems
  • Mobility-as-a-Service (MaaS) bundling
  • Seamless integrated mobility systems
  • Data and experience monetization and infonomics

In my role as AI & Smart Technical Leader in Canadian Technical Centre at General Motors of Canada, I lead AI and smart mobility projetcs related to connected mobility, HMI, active safety, prognostics and automated driving.

As a Senior Research Scientist at Vestec, Inc., I applied intelligent data analysis techniques in speech signal processing and recognition systems. I co-invented and filed several US patents about speaker adaptation, noise type identification, SNR estimation and smart speech enhancement.

I founded and coordinated the GUC Robotics and Autonomous Systems (RAS) research group. GUC RAS undertakes inter-disciplinary research in areas like intelligent automated systems, industrial automation, industrial robotics and mobile robotics.

I wrote a proposal for the establishment of University of Waterloo Center of Pattern Analysis and Machine Intelligence (CPAMI). CPAMI started officially on March 1, 2011 and I currently serve as an affiliated member of this center. I coordinated several focus groups in CPAMI such as Robotics and Autonomous Systems, Autonomous Systems and Real Time Distributed Design, Machine Perception and Sensors, Smart Mobility and domain adaptation group.

I wrote a number of winning research grant proposals for Natural Sciences and Engineering Research Council of Canada (NSERC Strategic Project Grant, NSERC Research Tools and Instruments and NSERC–Collaborative Research and Development Grant), Public Security Technical Program (PSTP), Microsoft, Public Works and Government Services Canada (PW&GSC), European Commission and Scientific Research and Experimental Development (SR&ED) for Canada Revenue Agency (total obtained funding is $2,681,636)

Rersearch Projects

  • Upgrading Egyptian Manufacturing from Embedded Systems to Cyber-physical Systems (Smart Factory EG-KTA), Knowledge & Technology Alliance , Academy Of Scientific Research & Technology, 2016-2018. Co-PI: Dr. Alaa Khamis.
  • MineProbe: A Distributed Mobile Sensor System for Minefield Reconnaissance and Mapping in Egypt. Research, Development and Innovation Programme (RDI-2), Scheme 1, EuropeAid/132-715/M/ACT/EG, Ministry of Scientific Research (MSR). PI: Dr. Alaa Khamis.
  • Recovering the Sight to Blind People in Indoor Environments with Smart Technologies. The Executive Programme of Scientific and Technological Cooperation between the Italian Republic and the Arab Republic of Egypt. October 2012. Co-PI: Dr. Alaa Khamis.
  • Join Research Grant under the South Africa/Egypt – Research Partnership Programme Bilateral Agreement 2012. Co-PI: Dr. Alaa Khamis.
  • Multiagent Planning and Exceution using a Holonic Architecture. Professional Service Agreement Menya Solutions Inc. 2012. Principle Investigator: Dr. Alaa Khamis.
  • DIScrimination of Critical Objects and EVents in PErvasive Multimodal SuRveillance Systems (DISCOVER)
    Funding Agency: NSERC-Collaborative Research and Development (CRD) CA$ 945,400)
    Research Consortium: PAMI Group at University of Waterloo, University of Sherbrooke, Defence R&D Canada - Valcartier, Thales Canada Inc. and Menya Solutions Inc.
    Principal Investigator: Prof. Dr. Mohamed Kamel
    Local Coordinator at University of Waterloo: Dr. Alaa Khamis
  • Conceptual Foundations of Cooperation in Distributed Surveillance. Professional Service Agreement PSA.AGR.1303.1904, Thales Canada, Inc. 2010. Pricinple Investigator: Dr. Alaa Khamis.
  • MUSES_SECRET: Multimodal SurvEillance System for SECurity-RElaTed Applications
    Funding Agency: The Ontario Research Fund Research Excellence (ORF-RE) Program, 2008-2011 ($6,409,000)
    Principal Coordinator: Prof. Dr. Emil M. Petriu, University of Ottawa, Canada
    PI at University of Waterloo: Prof. Dr. Mohamed Kamel
    Local Coordinator at University of Waterloo: Dr. Alaa Khamis
  • Automation towards Global Standards: Upgrading of Egyptian Factories with Automation Technologies
    Funding Agency: Industrial Modernization Center of Egypt and Siemens AG, 2008-2010
    Principal Coordinator: Dr. Hisham El-Sherif, German University in Cairo.
  • Service Robots Upgrading Urban Standards of Living (RoboCity2030)
    Funding Agency: Madrid Community, 2006-2008
    Principal Investigator: Prof. Dr. Carlos Balaguer, RoboticsLab, Carlos III University of Madrid, Spain.
  • Learning Objects Repositories Network (LORENT)
    Funding Agency: Natural Sciences and Engineering Research Council of Canada (NSERC), 2004-2008 ($7,500,000)
    Principal Investigator: Prof. Dr. Mohamed Kamel, PAMI Lab, University of Waterloo, Canada.
  • Service Robots in Metropolitan Areas
    Funding Agency: Madrid Community and Ministry of Education, 2006-2009, S-0505/DPI/0176 (302,594 Euros)
    Principal Investigator: Prof. Dr. Miguel Angel Salichs, RoboticsLab, Carlos III University of Madrid, Spain.
  • Peer to Peer Robot-Human Interaction (R2H)
    Funding Agency: Spanish Ministry of Education and Science, 2005-2008
    Principal Investigator: Prof. Dr. Miguel Angel Salichs, RoboticsLab, Carlos III University of Madrid, Spain.
  • Capture of Satellites by Robotics Manipulators using Computer Vision (ASIROV)
    Funding Agency: Spanish Ministry of Education and Science, 2005-2008, DIPI2005-04302 (51,527 Euros)
    Principal Investigator: Prof. Dr. Mohamed Fichouche, RoboticsLab, Carlos III University of Madrid, Spain.
  • Personal Robotic Assistant (PRA)
    Funding Agency: Spanish Ministry of Science and Technology (MCyT), 2002-2006, DPI2002-00188 (218,020 Euros)
    Principal Investigator: Prof. Dr. Miguel Angel Salichs, RoboticsLab, Carlos III University of Madrid, Spain.
  • Application of Advanced Design Methodology in Assistive Personal Robots
    Funding Agency: Madrid Community and Carlos III University of Madrid, 2006, UC3M-IEL-05-051 (14,500 Euros)
    Principal Investigator: Prof. Dr. Miguel Angel Salichs, RoboticsLab, Carlos III University of Madrid, Spain.
  • MATS (Flexible MechATronic aSsistive technology system to support persons with special needs)
    Funding Agency: European Union, 2001-2004, EU (IST-2001-32080)
    Principal Investigator: Prof. Dr. Carlos Balaguer, RoboticsLab, Carlos III University of Madrid, Spain.
  • Topological Navigation of Mobile Robots (TOPO)
    Funding Agency: Spanish Ministry of Science and Technology (MCyT), 2000-2002
    Principal Investigator: Prof. Dr. Miguel Angel Salichs, RoboticsLab, Carlos III University of Madrid, Spain.
  • Innovative Educational Concepts for Autonomous and Tele-Operated Systems (IECAT)
    Funding Agency: Directorate General for Education and Culture of the European Commission under the EC/USA Program for Cooperation in Higher Education and Vocational Education and Training, 1999-2003, (254800 Euro)
    Principal Investigator: Prof. Dr. Klaus Schilling, University of Wuerzburg, Germany.

Thesis Supervision

  • Ghadeer Abdelkader. Context-Aware Pedestrian Intent Prediction for Connected and Automated Vehicles. Ph.D. thesis, Ontario Tech University, Canada, 2019-2024.
  • Ahmed Elgazwy. Transformer Based Model for Pedestrian Intention Prediction. M.Sc. thesis, Ontario Tech University, Canada, 2021-2023.
  • Ahmed Hosny Abd El Gawad. Enhancing Image Corruption Robustness of Deep Learning-based Pedestrian Detection. M.Sc., Nile University, 2021-present.
    Current Position: Machine Learning Engineer at Brightskies.
  • Abdelrahman Ezz. Adaptive Optimal Task Assignment for Cooperative Autonomous Vehicles. M.Sc. thesis, Mechatronics Engineering Department, Faculty of Engineering and Materials Science, German University in Cairo, 2016-2018.
    Current Position: Software team lead at Valeo.
  • Ahmed Hussein. Market-based Approach to Multirobot Task Allocation. M.Sc. thesis, Mechatronics Engineering Department, Faculty of Engineering and Materials Science, German University in Cairo, 2012-2013.
    Current Position: IAV GmbH, Berlin, Germany.
  • Ahmed Wagdy Shehata. Adaptive Group Formation in Multirobot Systems. M.Sc. thesis, Mechatronics Engineering Department, Faculty of Engineering and Materials Science, German University in Cairo, 2012-2013.
    Current Position: BLINC Lab and Adjunct professor at University of Alberta, Canada.
  • Mohamed Yehia. Meta-heuristic Optimization-based Approach to Multirobot Task Allocation. M.Sc. thesis, Mechatronics Engineering Department, Faculty of Engineering and Materials Science, German University in Cairo, 2012-2013.
    Current Position: Software Engineer.
  • Waleed Ashraf Abdulhafiz. Bayesian Approach to Multisensor Data Fusion with Pre- and Post-Filtering. M.Sc. thesis, Mechatronics Engineering Department, Faculty of Engineering and Materials Science, German University in Cairo, 2011-2012.
    Current Position: Project Manager, Customer Service at Siemens Mobility, Germany.
  • Asser Mohamed El-gindy. Team-theoretic Approach to Cooperative Multirobot System. M.Sc. thesis, Mechatronics Engineering Department, Faculty of Engineering and Materials Science, German University in Cairo, 2011-2012.
    Current Position: IPG Photonics, Canada.
  • Ahmed Elmogy. Dynamic Task Allocation in Multisensor Surveillance Systems. Ph.D. thesis, Pattern Analysis and Machine Intelligence Lab, University of Waterloo, Canada, 2008-2010. Main-supervisor: Prof. Dr. Fakhri Karray.
    Current Position: Associate Professor, Prince Sattam Bin Abdulaziz University.
  • Bahador Khaleghi. Soft and Hard Data Fusion in Multisensor Surveillance Systems. Ph.D. thesis, Pattern Analysis and Machine Intelligence Lab, University of Waterloo, Canada, 2008-2010. Main supervisor: Prof. Dr. Fakhri Karray.
    Current Position: Staff Software Engineer, Machine Learning at Meta.
  • Allaa Hilal. Sensor Management Framework for Pervasive Surveillance Systems. Ph.D. thesis, Pattern Analysis and Machine Intelligence Lab, University of Waterloo, Canada, 2008-2010. Main supervisor: Prof. Dr. Otman Basir
    Current Position: VP, Monetization Analytics and Pillar Lead at Meta.
  • Mike Y-Q. Miao. A Study of Mobility Models in Mobile Surveillance Systems. M.Sc. thesis, Pattern Analysis and Machine Intelligence Lab, University of Waterloo, Canada, 2008-2010. Co-Supervisor: Prof. Dr. Mohamed Kamel.
    Current Position: Sr. Computer Vision/Machine Learning Specialist at General Motors.
  • Hassene Bouraoui. A Software Testbed for Assessing Human-Robot Verbal Interaction. M.Sc. thesis, Pattern Analysis and Machine Intelligence Lab, University of Waterloo, Canada, 2009-2010. Co-Supervisor: Prof. Dr. Fakhri Karray.
    Current Position: Agile Project & Product Management, Montreal, Canada.
  • Karim Elrayes. Dialogue Management System for Human-Robot Verbal Interaction. M.Sc. thesis, Pattern Analysis and Machine Intelligence Lab, University of Waterloo, Canada, 2010. Co-Supervisor: Prof. Dr. Fakhri Karray.
    Current Position: Research Scientist at University of Washington.
  • Ayman Abdel Rahman. A Distributed Multiagent Architecture for Mobile Multirobot Remote Interaction. M.Sc. thesis, Pattern Analysis and Machine Intelligence Lab, University of Waterloo, Canada, 2006. Co-Supervisor: Prof. Dr. Mohamed Kamel.
    Current Position: CEO of Kotobee, Managing Director at Vijua.
  • I supervised more than 50 bachelor projects at different universities in Canada, Spain and Egypt.
Many of the students I have supervised have gone on to build successful careers at leading global companies, including Meta, Google, Microsoft, General Motors, Siemens, and IAV GmbH. Their achievements reflect the practical, industry-focused training and guidance they received, preparing them for roles in some of the most innovative and well-known organizations worldwide.