Academic Project at Clemson University - International Centre for Automotive Research
Design and implemention of an embedded controller based on ultrasonic sensors to run down hill as fast as possible.
Achieved the following functions:
-
Adaptive Cruise Control
- Keep the RC vehicle 30 cm away from obstacles ahead.
- If obstacle ahead is stationary, vehicle should stop at 30 cm from obstacle.
-
Autonomous Lane Keeping
- Keep the vehicle along the center of a defined lane.
The objective of RL is to maximize the reward of an agent by taking a series of actions in response to a dynamic environment. Q-learning algorithm is taken into account to solve this problem. Q-learning is a values-based learning algorithm. Value based algorithms updates the value function based on following Bellman equation.
PID controller is non-model based controller. PID is a proportional, integrative and derivative controller. In PID there is no need to model the system relationship between input and output. PID compute the system input based on error directly. Used for throttle control and steering control.
- Arduino Uno Rev3
- Ultrasonic Sensor HC-SR04
- Ultrasonic sensor (1) for detecting obstacle ahead and other two sensor for lane keeping
- Electronic Speed Controller and servo motor to steer the vehicle.