Projects Q A Computer NewsLine Electronics NewsLine Jobs NewsLine Gadgets NewsLine Free Online Courses

Project abstracts and downloads for academic mini projects and final year projects

Home CSE/IT Projects ECE/EEE/EIE Projects Mechanical Projects MBA/BBA Projects Civil Projects Biomedical Projects

Q-Learning for Robot Control (Robotics Project)

Q-Learning is a method for solving reinforcement learning problems. Reinforcement learning problems require improvement of behaviour based on received rewards. Q-Learning has the potential to reduce robot programming effort and increase the range of robot abilities. However, most current Q-learning systems are not suitable for robotics problems: they treat continuous variables, for example speeds or positions, as discretised values. Discretisation does not allow smooth control and does not fully exploit sensed information. A practical algorithm must also cope with real-time constraints, sensing and actuation delays, and incorrect sensor data. This research describes an algorithm that deals with continuous state and action variables without discretising. The algorithm is evaluated with vision-based mobile robot and active head gaze control tasks. As well as learning the basic control tasks, the algorithm learns to compensate for delays in sensing and actuation by predicting the behaviour of its environment. Although the learned dynamic model is implicit in the controller, it is possible to extract some aspects of the model. The extracted models are compared to theoretically derived models of environment behaviour. The difficulty of working with robots motivates development of methods that reduce experimentation time. This research exploits Q-learnings ability to learn by passively observing

the robots actions rather than necessarily controlling the robot. This is a valuable tool for shortening the duration of learning experiments. Author: Gaskett, Chris Source: The Australian National University Download Project
Project: Electrical, Electronics & Communication Projects Tags: Robotics, Vision Share this on Facebook"

Subscribe for Electrical / Electronics Project Downloads (Free): Enter your email address:

Similar Projects:
o

Computing a Network of ASRs using a Mobile Robot Equipped with Sonar Sensors (IEEE Robotics Project) This paper presents a novel algorithm for computing absolute space representations (ASRs) for mobile robots equipped with sonar sensors and an odometer. The robot is allowed to wander freely (i.e. without following any fixed path) along the corridors in an...

Voice Controlled Robot (Robotics Project) When we say voice control, the first term to be considered is Speech Recognition i.e. making the system to understand human voice. Speech recognition is a technology where the system understands the words (not its meaning) given through speech. Speech...

Wall Climbing Robot (Robotics Project) This project is to build a wall climbing robot. This robot is a suction type of wall climbing robot; using PIC to do the interfacing, control the movement of the robot, ventilation fan and the sensors. The position sensors are...

The Memec Hexapod Robot: a demonstration platform (Robotics Project) This project shows how to replace a microcontroller unit (MCU) on a six legged robot,involving adapting hardware and developing software. The robot is based on the mechanics from Lynx motions Phoenix Hexapod Robot, which is a mechanical vehicle with 6...

Novel Integrated System Architecture for an Autonomous Jumping Micro-Robot (Robotics Project) As the capability and complexity of robotic platforms continue to evolve from the macro to micro-scale, innovation of such systems is driven by the notion that a robot must be able to sense, think, and act. The traditional architecture of...

Laser feedback control for Robotics in Aircraft Assembly (Robotics Project) The aim of this study is to investigate how the absolute accuracy of an industrial robot can be increased by monitoring the position of the robot. The motive is to automate high precision, low volume production such as aircraft industry....

Visual Servoing Based on Learned Inverse Kinematics (Electronics/Robotics Project) Initially an analytical closed-form inverse kinematics solution for a 5 DOF robotic arm was developed and implemented. This analytical solution proved not to meet the accuracy required for the shape sorting puzzle setup used in the COSPAL (COgnitive Systems using...

Post navigation
Previous : Web Based Claims Processing System (Software Project) Next : Using Metering Signals at Roundabouts with Unbalanced Flows to Improve the Traffic Condition (Civil Project)

Follow us on Google+

Comments are closed.

Search Projects

Custom Search

Subscribe
Get project abstracts to your Email:

Enter your email address:

All Projects Only CS / IT Projects Only ECE / EEE Projects Only Mechanical Projects Only MBA Projects Only Civil Projects

Latest Projects

A Power Efficient Active RFID Communication Protocol (ECE/EEE Project) Audio Guidance System for the Blind with Circuit Diagram (Electronics Project) Biometrics - Developing the Architecture, API, Encryption and Security (Computer/Electronics Project) Dial over Data solution (Electronics/Telecom Project) Automatic Railway Gate Control & Track Switching (Electronics Project) Amateur Satellite Tracking Communication System (Electronics Project) Mechatronics Design of a Low-Cost Packaging and Dosing Machine for Doughy Products (Electronics/Mechanical Project) Three Realizations and Comparison of Hardware for Piezoresistive Tactile Sensors (Electronics Project) Coupling of light from Microdisk Lasers into Plasmonic Nano-antennas (ECE/EEE Project) Wool--A C library for OSE PowerPC Multi-Core system (Electronics Project)

Amazing Gadgets

App that detects Drunken Drivers iPod Nano Pill Docking Speaker Keyboard of the Future LightPad turns your Smart Phone into a Laptop Order Food From An Interactive Tabletop Sphero, the Smartphone-Controlled Robotic Ball Throwable 36-Camera Ball takes perfect Panorama Pictures USB Watch Carrying your memory stick in style Worlds Smallest Camera sits on your fingertip

Follow us on Google+