Autonomous docking of a smart wheelchair for the Automated Transport and Retrieval System (ATRS)

20
Autonomous Docking of a Smart Wheelchair for the Automated Transport and Retrieval System (ATRS) Chao Gao, Thomas Miller, and John R. Spletzer Computer Science and Engineering Lehigh University Bethlehem, Pennsylvania 18015 e-mail: [email protected], [email protected] Ira Hoffman and Thomas Panzarella Freedom Sciences, LLC 4601 South Broad Street Philadelphia, Pennsylvania 19112 e-mail: [email protected], [email protected] Received 27 August 2007; accepted 30 January 2008 The Automated Transport and Retrieval System (ATRS) represents a technology-based alternative to van conversions for automobile drivers in wheelchairs. Rather than requir- ing dramatic, permanent, and expensive modifications to the host vehicle, ATRS employs robotics and automation technologies and can be integrated noninvasively into a stan- dard minivan or sport utility vehicle. At the core of ATRS is a “smart” wheelchair sys- tem that autonomously navigates between the driver’s position and a powered lift at the rear of the vehicle, eliminating the need for an attendant. From an automation per- spective, autonomously docking the wheelchair onto the lift platform presented the most significant technical challenge due to limited clearance between the chair wheels and the lift platform rails. To solve the docking task, we employed a light detection and ranging (LIDAR)–based approach for wheelchair localization coupled with a hybrid motion con- troller design. Extensive testing from the localization subsystem to the complete ATRS was conducted under representative usage conditions. This included 3 days of public demon- strations indoors at the World Congress on Disabilities, where potential end users were able to evaluate the system. In this environment, ATRS performed more than 300 consec- utive cycles without failure. During 2 days of outdoor reliability testing, 97.5% docking reliability was observed. The system is scheduled to enter the commercial market in 2008. C 2008 Wiley Periodicals, Inc. Journal of Field Robotics 25(4–5), 203–222 (2008) C 2008 Wiley Periodicals, Inc. Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/rob.20236

Transcript of Autonomous docking of a smart wheelchair for the Automated Transport and Retrieval System (ATRS)

• • • • • • • • • • • • • • • • • • • • • • • • • • • • • • •

Autonomous Docking of aSmart Wheelchair for theAutomated Transport andRetrieval System (ATRS)

Chao Gao, Thomas Miller,and John R. SpletzerComputer Science and EngineeringLehigh UniversityBethlehem, Pennsylvania 18015e-mail: [email protected],[email protected]

Ira Hoffman and Thomas PanzarellaFreedom Sciences, LLC4601 South Broad StreetPhiladelphia, Pennsylvania 19112e-mail: [email protected],[email protected]

Received 27 August 2007; accepted 30 January 2008

The Automated Transport and Retrieval System (ATRS) represents a technology-basedalternative to van conversions for automobile drivers in wheelchairs. Rather than requir-ing dramatic, permanent, and expensive modifications to the host vehicle, ATRS employsrobotics and automation technologies and can be integrated noninvasively into a stan-dard minivan or sport utility vehicle. At the core of ATRS is a “smart” wheelchair sys-tem that autonomously navigates between the driver’s position and a powered lift atthe rear of the vehicle, eliminating the need for an attendant. From an automation per-spective, autonomously docking the wheelchair onto the lift platform presented the mostsignificant technical challenge due to limited clearance between the chair wheels and thelift platform rails. To solve the docking task, we employed a light detection and ranging(LIDAR)–based approach for wheelchair localization coupled with a hybrid motion con-troller design. Extensive testing from the localization subsystem to the complete ATRS wasconducted under representative usage conditions. This included 3 days of public demon-strations indoors at the World Congress on Disabilities, where potential end users wereable to evaluate the system. In this environment, ATRS performed more than 300 consec-utive cycles without failure. During 2 days of outdoor reliability testing, 97.5% dockingreliability was observed. The system is scheduled to enter the commercial market in 2008.C© 2008 Wiley Periodicals, Inc.

Journal of Field Robotics 25(4–5), 203–222 (2008) C© 2008 Wiley Periodicals, Inc.Published online in Wiley InterScience (www.interscience.wiley.com). • DOI: 10.1002/rob.20236

204 • Journal of Field Robotics—2008

1. INTRODUCTION AND MOTIVATION

According to the U.S. Department of Transportation,more than six million people with disabilities havedifficulties in obtaining the transportation they need(National Council on Disabilities, 2005). This is a ma-jor contributor to the unemployment rate of the dis-abled population nationally, estimated at more than65% by the U.S. Census Bureau (Stern & Brault, 2005).These statistics are reinforced by research from thePennsylvania State Board of Vocational Rehabilita-tion, which found that transportation was critical forAmericans with disabilities to participate fully in ba-sic activities such as employment, education, wor-ship, job training, commerce, recreation, and other ac-tivities of community life that most people take forgranted (Pennsylvania Rehabilitation Council, 2006).

A van conversion is the de facto personal trans-portation solution for an individual in a powerwheelchair. Van conversions start with a standardvan produced by a major automotive manufacturer.The van is subsequently modified by another com-pany specializing in mobility equipment. The modifi-cations are permanent and include extensive changesto the chassis, frame, and interior. Typical modi-fications include removing and lowering the vehi-cle floor and relocating or replacing major subsys-tems such as the gas tank, fuel system, and heating/cooling systems of the vehicle (Wood, 2004). Whileenabling independent mobility, van conversions rep-resent a costly and unsafe transportation solution forwheelchair users.

Safety is compromised by the modifications, butmore significantly by the paradigm itself. Van con-versions place the operator in-wheelchair behind thesteering wheel of the vehicle. Entry/exit to the ve-hicle is also accomplished in-wheelchair via a rampor powered lift device. Such a design has signifi-cant safety shortcomings. Wheelchairs do not pos-sess levels of crash protection similar to those af-forded by traditional motor vehicle seat systems,and the provisions used for securing them are of-ten inadequate. It should not be surprising thenwhen research by the U.S. National Highway TrafficSafety Administration (NHTSA) showed that 35%of all wheelchair/automobile-related deaths werethe result of inadequate chair securement. Another19% were associated with vehicle lift malfunctions(NHTSA, 1997).

To eliminate these shortcomings, we have devel-oped a technology-based alternative to van conver-

sions for wheelchair users: the Automated Transportand Retrieval System (ATRS). ATRS employs roboticsand automation technologies and can be integratedinto a standard minivan or sport utility vehicle (SUV).At the core of ATRS is a “smart” wheelchair systemthat autonomously navigates between the driver’sposition and a powered lift at the rear of the vehi-cle. A primary benefit of this paradigm is that theoperator and chair are separated during vehicle op-erations as well as entry/exit. This eliminates the po-tential for injuries or deaths caused by both impropersecurement (as the operator is seated in a crash-testedseat system) as well as lift malfunctions. Further-more, by eliminating the drastic and permanent ve-hicle modifications associated with van conversions,ATRS will cost significantly less. ATRS represents therare case when an assistive technology provides ad-ditional functionality at a lower cost than currentalternatives.

This paper reviews the estimation and con-trol techniques used for autonomously docking thesmart wheelchair onto a power lift platform. Thiseliminates the need for an attendant to shuttle thewheelchair back-and-forth from the lift platform tothe driver’s seat—enabling personal independencethrough technology.

2. RELATED WORK

Extensive work has been done in order to increase thesafety levels of power wheelchairs while minimiz-ing the level of human intervention. In these systems,the human operator is responsible for high-level de-cisions while the low-level control of the wheelchairis autonomous.

The Tin Man system (Miller & Slack, 1995), de-veloped by the KISS Institute, automates some ofthe navigation and steering operations for indoor en-vironments. The Wheelesley project (Yanco, 1998),based on a Tin Man wheelchair, is designed forboth indoor and outdoor environments. The chairis controlled through a graphical user interface thathas successfully been integrated with an eye track-ing system and with single-switch scanning as in-put methods. The TAO Project (Gomi & Griffith,1998) provides basic collision avoidance, navigationin an indoor corridor, and passage through nar-row doorways. The system also provides landmark-based navigation that requires a topological map ofthe environment. The NavChair assistive wheelchairnavigation system (Simpson & Levine, 1999) uses

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 205

Figure 1. (Left) ATRS concept diagram. (Right) Beta ATRS showing the power seat, smart wheelchair, and lift platformsubsystems.

feedback from ultrasonic sensors and offers obstacleavoidance, door passage, and wall-following modes.More recently, the SmartChair (Parikh et al., 2003;Parikh, Grassi, Kumar, & Okamoto, 2004) uses a vir-tual interface displayed by an onboard projection sys-tem to implement a shared control framework thatenables the user to interact with the wheelchair whileit is performing an autonomous task.

A common theme in the above research is thatrobotics technology has been applied to assist or aug-ment the skills of the chair operator. In contrast, theATRS wheelchair is in fact capable of autonomous ve-hicle navigation in outdoor environments. This canbe realized because the operator is never seated in thechair during autonomous operations, and the chairalways operates in the vicinity of the automobile.The former constraint mitigates operator safety is-sues, while the latter provides significant, invariantlandmarks/features in an otherwise unstructured en-vironment. What also makes the ATRS wheelchair at-tractive is that it is commercially viable, providing asafer alternative to van conversions at a significantlylower cost.

We should also point out that for users of man-ual wheelchairs, there are alternatives to van con-versions for personal automobility. These range from“muscling” the collapsed wheelchair into the rearseat for those with sufficient flexibility and upper-body strength, to more dramatic commercial systemssuch as the ChairTopperTM, which integrates a liftinto a container that is mounted to the roof of an auto-mobile (Braun Corporation, 2006). However, these so-lutions are inappropriate for powerchairs, which typ-ically weigh 125–150 kg.

3. SYSTEM OVERVIEW

The ATRS can be decomposed into five primary com-ponents: a “smart” power wheelchair system, a lightdetection and ranging (LIDAR) system for localiza-tion, a powered lift platform, a traversing powerseat, and a touch-screen user interface (UI) computer.These are illustrated in the concept drawing and theATRS beta system shown in Figure 1. From a roboticsperspective, the smart wheelchair and localizationsystems are the heart of ATRS. Combined, these twosubsystems allow the operator to be separated fromthe chair and eliminate the need for an attendant.

In describing the ATRS operational procedures,we refer to Figure 1 (left). When the operator returnsto his/her automobile, a keyless entry is used to bothunlock the vehicle and deploy the traversing driver’sseat. The operator then positions the wheelchair andperforms a seat-to-seat transfer (pose A). After this,the wheelchair is deployed to the rear of the ve-hicle (pose B). In our proof-of-concept system, thisside traversal was completely autonomous (Sermeno-Villalta & Spletzer, 2006). In the current system, re-ferred to colloquially as “ATRS-Lite,” the wheelchairis remotely controlled by the vehicle operator via ajoystick located at the UI. Once the chair enters thehandoff site at the rear of the vehicle (pose C), itis automatically tracked by the localization systemused for docking. The wheelchair then switches to“docking” mode (either automatically or via a UIinput from the operator for the ATRS-Lite system),which enables the vanside computer to transmit real-time control inputs to the chair over a dedicatedradio frequency (RF) link for reliable docking(locking in place) onto the lift platform (pose D). With

Journal of Field Robotics DOI 10.1002/rob

206 • Journal of Field Robotics—2008

the chair docked, the operator actuates the lift viathe UI, stowing the platform and chair in the ve-hicle cargo area. The process is repeated in reversewhen disembarking from the automobile. We shouldemphasize that when not operating autonomously,the ATRS wheelchair is placed in “manual mode”and operates no differently from any other poweredwheelchair.

The primary focus of this paper is the develop-ment of a reliable, autonomous means for docking(and undocking) the ATRS wheelchair onto (and offof) the vehicle’s lift platform. Autonomous dockingwas dictated by the narrow clearances available onthe lift platform; teleoperation proved an unreliableproposition even for trained operators. Our initial ef-forts in this area investigated a vision-based controlapproach (Sermeno-Villalta & Spletzer, 2006). Patho-logical failure modes with the passive vision systemled us to our current configuration, which integratesa SICK LMS291 LIDAR for estimating the chair pose.We should also point out that whereas the paper fo-cuses on wheelchair docking, the same algorithmsare used in reverse during the undocking phase (al-though the undocking problem is significantly lessdifficult).

4. WHEELCHAIR CONTROL

The overall architecture for wheelchair control is pre-sented in Figure 2. Recall that there are two primary

Figure 2. Control architecture for passengerless wheelchair operation.

modes for controlling the ATRS wheelchair withoutan operator: remote control and autonomous opera-tions. In both cases, control inputs to the chair are sentvia a RF link from the vanside computer. From an au-tomation perspective, two aspects to the control prob-lem must be considered: motor control and motioncontrol. The motion controller generates higher levelvelocity commands vanside based on the currentchair pose as estimated via the localization systempresented subsequently. These are in turn transmit-ted to the powerchair, which regulates the wheel ve-locities to achieve the objective linear and angular ve-locities for docking.

4.1. Motor Control

The wheelchair employs a differential drive systemand as such can be accurately modeled through thecorresponding kinematic model

[wR

wL

]=

[1 b

1 −b

] [v

ω

], (1)

where (wR,wL) are the right and left wheel veloci-ties in meters/second and b is the differential drivewheelbase. Referring to Figure 2, the motion con-troller transmits objective linear and angular veloc-ities, which are in turn mapped to wheel velocitiesvia Eq. (1). These are then regulated by the chair viaa proportional–integral–derivative (PID) controller

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 207

implemented in software on the chair’s embeddedpersonal computer. Feedback to the PID is providedvia high-resolution quadrature encoders that mea-sure right and left wheel travel (�φL,�φR) at 100 Hz.

4.2. Motion Control

The design of the higher level motion controller wasinfluenced by real-world constraints associated withsystem use. These included actuation latency, dock-ing clearances, and the constrained ground area ad-jacent to the vehicle for navigation. Furthermore, thechair entry onto the lift platform has to be with suf-ficient velocity to ensure that a plough installed onits base will strike with sufficient momentum to pos-itively engage the docking mechanism that automat-ically secures the chair to the lift.

As such, our motion planner employed a hybridcontrol design consisting of two primary controllermodes: course correction and path following. In thisparadigm, gross alignment errors were first corrected(when necessary) in the course-correction phase be-fore proceeding to path following for docking. Ad-mittedly, this is a very conservative approach. How-ever, it served to minimize the impact of actuationlatency through the elimination of gross pose errorsand ensured that the wheelchair remained in closeproximity to the vehicle.

To ground the notation, coordinate frames usedin this paper are defined as shown in Figure 3. Wenow describe each mode in greater detail.

4.2.1. Path-Following Phase

Although the motion problem might be classified aspoint-to-point, there is one caveat. The velocity of thewheelchair at its objective pose must be significantlygreater than zero. This is a function of the docking

Figure 3. World W, LIDAR L, and wheelchair R coordinateframes.

procedure, which requires that a plough mountedto the chair bottom strike the dock with sufficientmomentum to actuate the locking mechanism. Asa result, we choose instead to treat it as a particu-lar case of path following and employ a traditionalproportional–derivative (PD) controller derived us-ing input/output feedback linearization techniques(Deluca, Oriolio, & Samson, 1998):

ω = −kv tan θ − kpy

v cos θ, (2)

where ω and v are the desired linear and angular ve-locities transmitted to the chair, v(t) is assumed piece-wise constant, kv, kp are positive controller gains, andy, θ are with respect to the world frame W. Fixingthe value for v ensured that the singularity at v = 0 isavoided. However, whereas Eq. (2) implicitly definesa trajectory, actuator constraints must also be accom-modated. For safety considerations, we specify max-imum linear and angular velocities [vmax, ωmax]T forthe chair. Typical values were 0.4 m/s and 0.9 rad/sin practice. (It should be noted that these are signifi-cantly less than what can be achieved by the actualhardware.) To accommodate these limits, we bor-row from Oriolo, Luca, and Vendittelli (2002) andconstrain the actual controller inputs to

ωact = S(ω) arg min{|ω|, ωmax},vact = ωact

ωvmax, (3)

where S( ) corresponds to the sign function. Theseconstraints ensure that whereas the wheelchair willno longer follow the same trajectory specified byEq. (2), it will follow the same path while protectingagainst actuator saturation.

Last, one further refinement was made to thepath-following mode. By exploiting the two degreesof mobility offered by the differential drive system,Eq. (2) was immediately preceded by an orienta-tion correction. The intent was to find an initialorientation θ∗ such that the magnitude of ω0 wasminimized—and ideally zero. Squaring both sides ofEq. (2), setting w = ω2, differentiating w with respectto θ , and setting the result equal to zero, we obtaintwo possible solutions:

θ∗ ={− arcsin

(kpy

kvv

),− arcsin

(kvv

kpy

)}. (4)

Journal of Field Robotics DOI 10.1002/rob

208 • Journal of Field Robotics—2008

Figure 4. Wheelchair path without (left) and with (center) orientation correction. The latter not only improves the settlingdistance but also ensures that the chair remains in closer proximity to the vehicle (right).

The first also corresponds to directly setting Eq. (2)to zero. So, for the case where |(kpy)/(kvv)| ≤ 1 thereis an initial orientation for our path follower that re-quires zero initial angular velocity. Fortunately, ourconfiguration parameters allow such an orientationto be readily achieved. Thus, all initial orientationerror can be removed prior to initializing the path-follower controller. This reduces the settling dis-tance of the wheelchair, as well as constraining thewheelchair path closer to the vehicle. The effect is il-lustrated in a simulation trial for a representative gainset (Figure 4).

An additional advantage of the orientation cor-rection phase is that the path-follower controller op-erates away from the singularity at θ = ±π/2. Be-cause typical gain sets are {kp, kv} ≈ {1, 2} and v ≈0.4 m/s, |θ∗| ≤ 30 deg. Furthermore, with appropri-ate gains Eq. (2) ensures that the value for θ de-creases from θ∗ across the trajectory. This assumesthat y-position errors are ≤0.4 m. This was ensured(when necessary) through a course-correction phasedescribed below.

4.2.2. Course-Correction Phase

To enhance wheelchair docking reliability, a course-correction mode is also incorporated to address grossy-position errors. This controller phase is activated af-ter initial localization in autonomous model only ifit is determined that the path-following mode wouldbe at risk for failing to dock the chair at the hand-off location provided by the operator (e.g., for largey-position errors). In this event, we again exploit thechair’s two degrees of mobility to align the chairalong the x axis in our world frame. This is accom-plished through the following pair of control inputs

that are processed serially:

dθR = −θmaxS(y0) − θ0, (5)

dxR = abs(y0)sin θmax

, (6)

where (dθR, dxR) are with respect to the wheelchairframe, y0, θ0 denote the initial y position and orien-tation of the wheelchair, respectively, and θmax corre-sponds to a maximum allowable orientation angle forthe wheelchair that ensures that both features beingtracked by the LIDAR system would remain visible.(Typical values during development were θmax = 60–75 deg.)

Figure 5 illustrates the effect of these control in-puts on a representative docking trial. Figure 5(a)shows the wheelchair’s initial pose. Figures 5(b) and5(c) illustrate the orientation and y-position correc-tion modeled by Eqs. (5) and (6), respectively. At thispoint, nearly all y-position error has been eliminatedfrom the wheelchair pose. Finally, Figure 5(d) showsthe wheelchair reorienting to the optimal orientationdefined by Eq. (4), which immediately precedes thepath-following control phase from Eq. (2). The net re-sult is a dramatic reduction in the settling distance.This, in conjunction with the orientation correctionphase prior to path following, also serves to eliminatevehicle operations around the singularity conditionin Eq. (2), i.e., when θ = ±90 deg.

4.2.3. Motion Controller Simulation Results

To demonstrate the efficacy of the hybrid control ap-proach, simulations were first conducted to assessdocking performance. Docking trials were conducted

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 209

Figure 5. Laboratory docking trial test illustrating the course correction mode (a–c) and orientation correction phase of thepath-follower mode (d). This hybrid approach allows for reliable docking across the operational envelope of initial chairposes.

over a 1.2-m2 handoff area in front of the lift platformusing uniform sampling with a discrete position reso-lution of 1 cm. For each trial, docking was consideredsuccessful if immediately prior to reaching the plat-form ramp, y-position errors were ≤5 cm and orien-tation errors were ≤10 deg. These criteria were basedon empirical observations that would lead to a suc-cessful wheelchair dock.

Simulations were conducted for representativegain sets using purely a path-following controller,path following preceded by orientation correction,and finally with a course-correction mode integrated.Results from a representative set of trials are illus-trated in Figure 6. In this figure, the darker dotscorrespond to positions where docking failed at atleast one initial orientation. Dramatic improvementsin controller performance can be seen through theintegration of the orientation-correction and course-correction modes.

5. WHEELCHAIR LOCALIZATION

5.1. Vision-based Approach

The localization approach for ATRS has evolved sig-nificantly over the past two and a half years, andwe would admit that as of this writing it is still un-der development. Our initial implementation demon-strated on the proof-of-concept system was visionbased (Sermeno-Villalta & Spletzer, 2006). A high-resolution, black-and-white Point Grey Dragonflycamera using a wide-field-of-view (90-deg) lens wasmounted to the inside of the vehicle liftgate. Withthe liftgate opened, the camera had a “bird’s-eye”

view of the wheelchair and lift platform as shownin Figure 7. Using normalized intensity distributionas a similarity metric (Fusiello, Trucco, Tommasini,& Roberto, 1999), binary fiducials were tracked onthe wheelchair armrests. Assuming a ground planeconstraint, this allowed the pose of the wheelchairto be directly estimated. The vision-based solutionwas demonstrated to industry representatives in June2005 and subsequently evaluated on the systemthrough October 2005. During this time, the vehiclewas driven more than 5,000 km, and the camera didnot require recalibration.

There were several advantages to the vision-based approach. First, it was highly accurate. Basedon analysis of reprojection residuals from cameracalibration, the estimated positioning accuracy ofthe localization system was subcentimeter. This wasmore than sufficient for the docking task. The cam-era system also had a very compact form factorand was relatively inexpensive. However, its per-formance could suffer in degraded weather condi-tions (e.g., snow or rain). Furthermore, we identifiedpathological failure modes even in benign weatherconditions. For example, with the vehicle parkedunderneath a tree on a sunny day, the fiducials be-ing tracked would transition across regions of highbrightness (from the sunlight) to deep shade (fromthe tree leaves). The limited dynamic range of thecamera charge-coupled device could not compensatesufficiently for these differences in illumination, re-sulting in a lost fiducial track and localization fail-ure. The shortcomings of the vision system led us tomigrate to the LIDAR-based approach currently usedin the ATRS beta model. Similar techniques have seen

Journal of Field Robotics DOI 10.1002/rob

210 • Journal of Field Robotics—2008

Figure 6. Controller performance for a sample gain setwith the PD control law (top), orientation correction inte-grated (center), and course correction added (bottom). Thelatter eliminated residual poses associated with dockingfailure. Simulation resolution was 1 cm2.

widespread used in the robotics field (Dissanayake,Newman, Clark, Durrant-Whyte, & Csorba, 2001;Howard, Parker, & Sukhatme, 2006; Leonard &Durrant-Whyte, 1991; Lingemann, Surmann, &Hertzberg, 2005; Lionis & Kyriakopoulos, 2002), anda LIDAR/beacon approach was deemed a low-risksolution for the docking task.

5.2. LIDAR-based Approach

In the beta ATRS, the primary sensor used for esti-mating the wheelchair pose with respect to the lifeplatform is a SICK LMS291 LIDAR. Figure 8 (top) il-lustrates a typical integration of the LIDAR into thevehicle lift platform. The LMS291 measures the line-of-sight range to objects in the environment over a90-deg field of view with a discretization of 0.5 deg.Each of these measurements can be written as a tu-ple of the form zm = [r, α, γ ]Tm, m = 0 . . . 180, where rm

and γm denote the measured range to and reflectivityof the mth feature at a bearing of αm = m/2 − 45 degwith respect to the LIDAR sensor frame L. To sim-plify the feature segmentation process, two cylindri-cal retroreflector fiducials were permanently affixedto the front of the wheelchair, as shown in Figure 8(center). When imaged by the LIDAR, a significantportion of the incident beam is reflected directly backto the detector, saturating the photodiode. This al-lows a simple threshold on reflectivity γmin to be usedas the primary filter for segmenting the target fea-tures. An additional level of filtering is based on arange constraint rmax. As the wheelchair is presentedin the immediate vicinity of the lift platform, targetsat excessive ranges (e.g., >4 m away) can immedi-ately be disqualified from potential features of inter-est. From these two filters and assuming a groundplane constraint, we construct a valid feature set:

F =[

rn cos αn

rn sin αn

], s.t. rn < rmax, γn > γmin. (7)

During all testing, γmin = 250, rmax = 400 cm (in hind-sight, γmin could have been set to 255 based on the testresults for an even stronger validation gate). This is il-lustrated in a representative LIDAR scan in Figure 8(bottom).

After this filtering phase, valid features wereclustered in Euclidean space as “candidate fiducials”based on the known fiducial size (d = 5.2 cm). Everyhypothetical fiducial pair was then evaluated againstthe known fiducial baseline (|tl − tr | = 44 cm). Any

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 211

Figure 7. Sample docking trial with the proof-of-concept system, showing the camera perspective and the estimated chairposition over time.

pair within preset tolerance of the known baselinewas considered a valid chair pose. If and only if onevalid chair pose was obtained, the wheelchair seg-mentation was considered to be successful. Other-wise, the user would be notified via the UI to takecorrective action (i.e., reposition the chair) and thesegmentation process repeated. This approach hasproven to be extremely reliable in real-world con-ditions. However, to further enhance robustness tooutliers in extreme conditions (e.g., heavy rain), therecovered fiducial positions are not directly used. In-stead, median filters (typically seven elements) areapplied to the recovered range to each fiducial clus-ter. These filtered ranges are then used to estimatethe final fiducial positions. With the position of bothretroreflectors known, estimating the chair positionand orientation (assuming a ground plane constraint)was straightforward.

Whereas we previously investigated usingan extended Kalman filter (EKF) to fuse LIDARand wheelchair odometry measurements (Gao,Hoffman, & Spletzer, 2007), the current localizationimplementation uses a simpler approach wherebythe wheelchair position and orientation are esti-mated directly at each timestep from the recoveredfiducial positions. This simpler implementation wasmotivated from significant testing of the localizationsubsystem, as well as system-level testing outdoors.First, we determined that the positioning accuracyof the LIDAR system was subcentimeter without

temporal filtering. Second, significant wheel slip-page from gravel, sand, etc., was observed whentesting the wheelchair outdoors. Such uncertaintyin the odometry measurements results in an EKFimplementation that relies primarily on the LIDARmeasurement updates anyway and places very littleweight on the odometry measurements. Finally, theuse of median filters on the range measurements toreject outliers introduced from rain, etc., introducesits own temporal filtering and raises questions as tohow the measurements should be correctly fused inthe EKF. Although the EKF implementation may berevisited, the test results discussed in Section 8 reliedon the direct localization approach.

6. FAILURE RECOVERY

Regardless of the controller design, there inevitablyremains the potential for unmodeled disturbances tocompromise controller performance and cause dock-ing failure. Without corrective action, this could leavethe vehicle operator stranded with the wheelchairtrapped in a “partially docked” position on the liftplatform. To minimize the potential for such a fail-ure, we leverage the robustness of the localizationsystem. Immediately prior to the wheelchair reach-ing the ramp of the lift platform, the vanside com-puter makes a go/no-go decision based on the esti-mated chair pose. If docking is not assured with avery high confidence based on this pose estimate, the

Journal of Field Robotics DOI 10.1002/rob

212 • Journal of Field Robotics—2008

Figure 8. (Top) TrackerTM lift platform with integratedLMS291. The LIDAR housing provides environmental pro-tection and integrates a visor to improve system SNR.(Center) Powerseat and smartchair with retroreflectivetargets clearly shown. (Bottom) Range and reflectivitydata from a single LIDAR scan. The reflectivity measure-ments of the fiducial targets (twin peaks) facilitate featuresegmentation.

chair is stopped and the operator notified via the UIto reposition the chair via the remote-control joystickso that autonomous docking can be reattempted.

However, should the LIDAR system fail, au-tonomous docking would not be feasible. To addressthis case, a camera system capable of streaming videoto the UI is colocated with the LIDAR on the lift plat-form to support teleoperation. As mentioned previ-ously, a teleoperation mode was not sufficiently re-liable for day-to-day operations. However, operatorswere able to successfully dock the chair most of thetime. As such, it provides a fallback docking modal-ity in the event of a primary sensor failure.

7. LOCALIZATION SUBSYSTEM TESTING

Extensive testing of the localization subsystem wasconducted to characterize its performance in bothbenign and degraded conditions. Most of this test-ing was accomplished using the modified turntableassembly shown in Figure 9. This test fixture de-sign offered two significant benefits. First, the sim-ulated wheelchair position estimates could be pro-jected to a single point (the center of rotation) sothat “ground truth” localization accuracy could bewell characterized. Second, the rotation allowed usto simultaneously simulate wheelchair motion in acompact footprint. The fiducials were mounted onan arm and spaced 44 cm apart (the same distanceas on the actual wheelchair used in development).The standard turntable angular velocity (33-1/3 rpm)corresponded to an instantaneous fiducial velocity

Figure 9. Test fixture used throughout localization sub-system testing. The turntable modeled wheelchair motionwhile allowing the simulated wheelchair position estimatesto be projected to a single point.

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 213

of 0.77 m/s. The actual chair geometry and maxi-mum wheelchair linear and angular velocities usedduring development (0.4 m/s and 0.9 rad/s, respec-tively) translated to a worst-case fiducial velocity of0.68 m/s. As such, the turntable rotation was onlyslightly more aggressive than the “worst case” mo-tion for the wheelchair.

During all testing with the turntable, it was as-sumed that the orientation of the wheelchair wouldbe constrained to [−75 deg, 75 deg] to protect againstself-occlusion of the retroreflector targets. Test datawere collected and evaluated only in this range. TheSICK itself was configured with a 500-kbps connec-tion, which has achieved valid scan rates of approxi-mately 70 Hz during laboratory testing.

7.1. Baseline Performance Testing

All baseline testing was conducted at midday (from11 am to 2 pm) under clear skies to ensure highsolar load conditions in an attempt to maximizephotodetector noise. Ambient light levels were mea-sured using a light meter and typically exceeded100 klx.

The turntable used for testing was initially placedat a nominal position of (x, y) = (1.0 m, 0.0 m)with respect to the LIDAR coordinate frame. Theturntable was then actuated, and the fiducials trackedby the SICK for a minimum of 5,000 scans. Thex distance to the turntable was then increased by0.5 m, and the process was repeated. This procedurewas iterated for x = 1.0–4.0 m and for y = {0.0, 0.5} m.The entire test procedure for all ranges was then re-peated with the turntable and fiducials facing thesun.

During these tests, the number of hits per fidu-cial was also recorded to determine whether wecould approach the theoretical tracking limits basedon fiducial dimensions, angular discretization, andbeam divergence. Results from specific subtests areas follows.

7.1.1. Reflectivity Stability

Recall that the motivation for using retroreflectorfiducials was to simplify the feature segmentationtask by using the reflectivity measurements from theLMS291. As such, the goal of this subtest was to deter-mine whether a single fixed threshold could be usedfor filtering measurements based on the reflectivityvalue.

Figure 10. Mean reflectivity values for the fiducials andbackground at all baseline ranges. The fiducial reflec-tivity was maximum (255) for all scans across all testconfigurations.

The results showed that under all test config-urations listed in Section 7.1, the reflectivity mea-surement value from the retroreflectors saturated theSICK’s 8-bit buffer (γ = 255). In fact, we continuedto increase the distance to the fiducials beyond thebaseline conditions and determined that this wouldremain the case at ranges in excess of 14 m! This is farin excess of the planned tracking distance of <4 m,providing a significant safety margin for threshold-ing. Reflectivity “noise” levels (the reflectivity of thebackground) also seemed unaffected by the sunlightor sun orientation and remained at approximately50 throughout all trials. Summary subtest resultsare presented in Figure 10. Whereas there is alwayspotential for direct or reflected sunlight to dazzlethe SICK, the integrated visor and occlusion by thewheelchair body has prevented this from happeningto date. From this, we concluded that a single fixedthreshold could be reliably used as one binary filterfor fiducial segmentation.

7.1.2. Localization Accuracy

Scan data were evaluated to characterize the accuracyof the localization approach. A sample plot for nomi-nal x–y coordinates of (2.0, 0) is shown in Figure 11(left), and summary data for all positions are inFigure 11 (right). Assuming an unbiased estimator,

Journal of Field Robotics DOI 10.1002/rob

214 • Journal of Field Robotics—2008

Figure 11. (Left) Distribution of wheelchair position estimates for a sample trial. (Right) Variance of x–y position and meansquare error.

that is, the mean position of the distribution is theactual center of rotation, the mean absolute error atall ranges was <7.5 mm; at ranges less than 2.5 m, itwas <4 mm. This is an order of magnitude smallerthan the docking tolerance (≈4–5 cm), which high-lights the efficacy of the localization approach.

7.1.3. Fiducial Segmentation Reliability

In conjunction with the localization testing, data werealso collected to determine the number of LIDAR hitsper fiducial as a function of target range. Althoughthis could be estimated from the angular resolutionand beam divergence specifications from SICK AG(2003), it was not known what fraction of the spotsize would still result in saturation of the reflectiv-ity measurement and as a consequence a fiducial de-tection. As such, empirical data were used to quan-tify this. To this end, more than 360,000 LIDAR scanswere evaluated. A histogram showing summary datafrom one set of trials can be found in Figure 12. Withthe exception of 4 m, a minimum of two hits wererecorded at every range for every scan. At the 4-mrange, 99.46% of all scans had two or more hits. Asthe final LIDAR scan rate (75 Hz) will be far in excessof the control updates rate to the chair (15 Hz), thesecould easily be filtered so that a minimum of two fea-tures can be required to define a viable fiducial clusterfor wheelchair localization.

7.2. Damaged Fiducial Tests

The purpose of these subtests was to simulate the ef-fects of wear and tear on the retroreflector fiducialsand estimate its impact on localization performance.During these subtests, the left retroreflector fiducialwas covered on the rear side by a 2-cm black stripe.The front sides of both fiducials were left unchanged.This test setup is illustrated in Figure 13. As a result,when the front side of the turntable arm assemblywas visible to the LIDAR, we collected data for theundamaged baseline configuration. The rear side cor-responded to our “damaged” fiducial case. This al-lowed a simultaneous comparison without any otherchanges in the test configuration.

More than 10,000 scans were made to ensure aminimum set size of 5,000 samples for both the dam-aged and undamaged retroreflector configurations.These trials were conducted for x = {1.0, 2.0, 3.0,4.0} m, y = 0.0 m. A sample plot for nominal x–y

coordinates of (1.0 m, 0.0 m) is shown in Figure 14(top). Whereas the variance of the position estimatesfrom the damaged fiducials was greater than that ofthe baseline system, mean absolute errors were still<7 mm for all trials. This is illustrated in the sum-mary data in Figure 14 (center). We also observed atypical 3-mm y-position bias between the mean po-sition of the two distribution sets at each range. Thiscan also be seen in Figure 14 (bottom). Again, this alsowas not unexpected, as we deliberately covered only

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 215

Figure 12. Histogram of scan hits per fiducial. Results indicate that a minimum of two hits can be required to validate acluster, which aids in outlier rejection.

Figure 13. (Left) Undamaged fiducials on the front side. (Right) Simulated damaged fiducials on the arm’s rear side. Thisallowed a simultaneous comparison of damaged fiducial position accuracy versus an undamaged baseline system.

one fiducial to investigate the bias effect as such er-rors cannot be removed through the EKF. However,even with this bias the y-position errors were stillless than 1 cm, which again is far below our dockingtolerances.

7.3. Headlight Interference Tests

The primary objectives of this test were as follows:

1. Determine whether secondary light sources(e.g., headlights from neighboring automo-

biles) could saturate the LMS291 reflectivitymeasurement or dazzle the SICK.

2. Determine whether the current filtering ap-proach was sufficient to segment out the fidu-cials in the presence of headlight interference.

Two different subtests were conducted. The firstwas to determine whether headlights could in factinterfere with the LIDAR system. These were con-ducted with the SICK staring at an automobilewith halogen headlights at ranges of 2.5, 5.0, 7.5,and 10.0 m. Data were then recorded without and

Journal of Field Robotics DOI 10.1002/rob

216 • Journal of Field Robotics—2008

Figure 14. (Top) Position estimate distributions for dam-aged and undamaged fiducials at 1 m. (Center) Mean ab-solute error comparison for the damaged and undamagedfiducials. In both cases, this was still <7 mm for all trials.(Bottom) y-position bias from one-sided damage was 3–4mm at all ranges.

with the headlights on to ensure a proper baseline.After this, an additional trial was conducted withthe turntable assembly placed between the car andthe SICK LIDAR to determine whether the fiducialscould still be successfully segmented.

From these tests, we determined that under ap-propriate conditions the car headlights would bothsaturate the reflectivity measurement (γ = 255) anddazzle the SICK photodiode. This occurred at allranges tested, and both phenomena could occur si-multaneously. A sample trial from our fiducial track-ing experiment is shown in Figure 15. The left-handpanel shows the raw reflectivity measurements. Theheadlight effects are labeled as noise. Note also theimmediate drops in reflectivity after the noise spikes.These correspond to the SICK being dazzled. Theright-hand panel shows the resulting fiducial seg-mentation. In this case, the segmentation is correctand the headlight effects are ignored based solely onrange thresholds. It must be emphasized that in prac-tice this will not always be the case. It would be quitecommon for vehicles to be within the 4.5-m-rangethreshold in parking lots. However, during testingit was also observed that always only a single bear-ing angle would have a γ = 255 reflectivity value re-quired by the thresholding filter. As a result, requir-ing a minimum valid cluster size of two elements asoutlined in Section 7.1.3. will also prevent this falsepositive from being identified.

7.4. Rain Testing

The objectives of these subtests were as follows:

1. Estimate the impact of rainfall on fiducial seg-mentation performance.

2. Determine the impact of rainfall on wheel-chair localization accuracy.

To protect the turntable assembly electronics,these tests were conducted using two static fiducials.As the LMS291 integrates rain protection in the nearfield (ranges <2 m), rain testing focused on stand-off distances of 3–4 m from the LIDAR. Trials wereconducted under five different conditions: no rain(baseline) and light, medium, heavy, and very heavyrain (i.e., peak rainfall during a thunderstorm). Thepositions of the fiducials and the LIDAR were fixedthroughout the testing process to ensure fair compar-ison of the localization accuracy.

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 217

Figure 15. Raw (left) and filtered (right) reflectivity data from headlight interference testing. In this case, the range filterallowed the fiducials to be reliably segmented.

Figure 16 summarizes the mean absolute errorfor the four rain scenarios at 3-m distance. We seethat light to medium rain had little to no effect onthe feature segmentation and localization accuracy;mean absolute error was less than 5 mm. However,heavy rain increased the “random” error componentto >2 cm.

A second impact of rainfall was that outliersin range measurements were observed. When thisoccurred, a significantly shorter than actual rangewas obtained. Bearing angle and reflectivity measure-

Figure 16. Mean absolute error for rain trials. This “ran-dom” error component increased dramatically with therainfall rate.

ments remained consistent throughout the trials. Asthese outliers were not observed during testing underbenign conditions, we inferred that raindrops causedsufficiently large returns so as to queue the “start ofpulse” for the range measurement and the pulse wasof sufficient length to register the associated fidicuialreflectivity. Figure 17 illustrates this effect during asample rain trial, where the positions of both the leftand right fiducial have been estimated from the rawrange and reflectivity measurements.

Several significant outliers can be observed in thetop fiducial position estimate. Without additional fil-tering, these outliers can lead to two different, seem-ingly valid—but incorrect—wheelchair poses. Thefirst case stems from when the range error induces afailed fiducial segmentation (case A in Figure 17). Thenet result is a false cluster being introduced into thescan: one from the left and two from the right fidu-cials. In this case, by chance the two clusters fromthe right fiducial better matched the known fiducialbaseline and are designated the optimal cluster pair.If this pair was accepted, the resulting localization re-sult would be shown in Figure 18 (left).

The second, perhaps the more anticipated case,was where the fiducial segmentation was correct butthe range error led to a large error in pose (caseB in Figure 17). Such an error has the potential topass through several filters currently used in thechair localization process, including using geomet-ric constraints of known fiducial baseline. An ex-ample of this case is illustrated in Figure 18 (right).

Journal of Field Robotics DOI 10.1002/rob

218 • Journal of Field Robotics—2008

Figure 17. Fiducial position estimates during rainfalltesting.

In this case, a bad range estimate to the right fidu-cial leads to dramatic position and orientation error.Fortunately, integrating either of our two validationgates—accepting only fiducial clusters with two ormore hits (Section 7.1.3) and accepting only scans thathave a single valid fiducial pair (Section 5.2)—wouldenable both of these cases to be rejected as outliers.

To further improve fiducial segmentation robust-ness and reject outlier range measurements, medianfilters have been added that track the raw range andbearing measurements. Filtered measurements arethen used as validation gates for outlier rejection.

8. SYSTEM-LEVEL TESTING

For all system-level testing, ATRS was integrated intoa Chrysler minivan. The power lift was a Freedom

Lift TrackerTM system. The wheelchair was InvacarePronto M91 w/MK5 Electronics. This lift platform/power chair combination allowed for approximately±6 cm of clearance between the chair wheels and thelift rails for the docking task.

8.1. Public Demonstrations

There have been numerous demonstrations of ATRSboth indoors and outdoors to potential end users,members of the media, industry personnel, and stateand local government representatives. The largestof these included 3 days of continuous demonstra-tions at the World Congress Exposition on Disabili-ties (WCD 2006) in November 2006. This was donenot only to verify docking robustness, but also toprovide potential end users (conference participants)with an opportunity to use the system and providefeedback on such issues as human factors engineer-ing and human–robot interaction (HRI). More than300 cycles of docking and undocking were conductedduring this time without a single failure. A sampletrial is illustrated in Figure 19.

8.2. Outdoor Testing

ATRS has been informally tested outdoors during thepast year of development. In this section, we summa-rize our most recent results, which consisted of 3 daysof continuous system testing. Two days were ded-icated to reliability testing, and the third sought tocharacterize the system performance under atypicalconditions.Reliability Testing In its current configuration, theintended operational environment for ATRS is paved,locally flat parking areas. This includes operationson moderate slopes so long as the surface betweenthe lift platform and chair is approximately planar.

Figure 18. Chair pose outliers resulting from failed fiducial segmentation (right) and poor fiducial position estimate (left).Both were caused by range measurement outliers but are filtered by current validation gates.

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 219

Figure 19. ATRS demonstration at WCD 2006. The operator performs a seat-to-seat transfer (left), and then remotelycontrols the wheelchair to the vicinity of the lift platform (center). At this point, the LIDAR tracks the chair while sendingreal-time control inputs over a dedicated RF link. Autonomous operations conclude with the chair successfully docked(right).

Although this may appear restrictive, these require-ments are significantly less constraining than theAmericans with Disabilities Act (ADA) standardsfor accessibility. These specify a maximum slope forhandicapped parking spaces not exceeding 1:50 (2%)in all directions (28 CFR Part 36, 1994). Whereasthe beta ATRS design can accommodate significantlygreater grades as well as departures from the groundplane assumption of nearly twice this magnitude, the2 days of reliability testing were conducted in park-ing spaces conforming to ADA requirements.

Over the 2-day test period, 121 docking runswere made. A run was considered successful if theplough mounted to the wheelchair base successfullyengaged the dock on the lift platform, thereby lock-ing the wheelchair into place for safe transport. Thiscould be objectively determined from visual inspec-tion. (There is also an electronic indicator from thedock itself.) Of the 121 runs, the wheelchair success-fully docked without further input from the opera-tor on 118 trials for a 97.5% success rate. Ideally, wewould like to see 100% success under such condi-tions. However, in each of the three failed runs thewheelchair could be recovered by the user throughteleoperation via the UI’s joystick. A subsequent at-tempt to dock was successful in each case, so wecould consider the system to have achieved 100%docking reliability during this subtest.

Regardless, further examination of the failedruns is warranted. Figure 20 summarizes the test re-sults, showing the initial and final positions of thewheelchair as estimated by the localization system.Successful runs are shown as + signs, and failedruns as x’s. In one of the three failed trials, the cul-

prit appears to have been our “heartbeat thread.”This serves as a watchdog for communication fail-ure and e-stops the chair if constant communicationis not maintained between the wheelchair and van-side computers. In this case, the only thing requiredfor resuming docking was for the user to again pressthe “dock” button at the UI. We expect this problemcan be ameliorated through software changes alone.

In the remaining two failed runs, the wheelchairdrove onto the dock with too much y-position errorfor the docking mechanism to engage the wheelchairplough. Examining the log files from these runs in-dicates that the PID motor controllers were dramat-ically failing to achieve the setpoints dictated by thelinear and angular velocities specified by the motionplanner. This can be attributed to a single fixed gainset being used for the motor controllers. Per the sug-gestion of the reviewers, we plan to integrate adap-tive gains for the PID controllers to resolve this issue.It should also be noted that the go/no-go behaviordiscussed in Section 6 was not integrated during thistesting. Although this would not have improved thedocking performance, it would have simplified theteleoperation recovery task for the two failed trials.Operational Testing in Nonconforming Environ-ments The third day of testing was dedicated to test-ing ATRS in more challenging conditions than ADA-conforming parking spaces. The primary goal ofthese tests was to better characterize the operationalenvelope of the system. Specific subtests includeddocking with the lift platform elevated (from comingto rest on a brick approximately 5 cm thick), as wellas docking trials on broken asphalt and sand/gravel-covered surfaces. The test conditions were sometimes

Journal of Field Robotics DOI 10.1002/rob

220 • Journal of Field Robotics—2008

Figure 20. Summary results for 2 days of docking reliability testing showing the initial (left) and final (right) distributionsof chair positions as estimated by the localization system. The three failed trials are marked with x.

further aggravated by the deliberate placement ofsticks and stones in the wheelchairs’s path, as wellas the introduction of vehicle exhaust and sand/duststreams in front of the LIDAR window. Images fromseveral trials can be found in Figure 21.

In general, docking performance under theseconditions was good. If the initial pose of thewheelchair was reasonable, the chair could still dockreliably on these surfaces. Localization system perfor-mance was unaffected by the sand and dust streams,and the chair was able to reliably dock on the raisedplatform. However, it was also easy to deliberatelyconstruct a condition in which the chair would fail todock. Docking was less robust to gross initial pose er-rors than during reliability testing. Furthermore, weobserved significant wheel slippage from the sandand gravel. In one specific case, the wheelchair had tobe manually recovered via the UI when the left wheelentered a “depression” in the ground and could notgain sufficient traction to exit.

Whereas these results are less objective than thereliability testing, they indicate that an automatedwheelchair has sufficient mobility for docking on awide range of surfaces and system docking reliabil-ity can be made quite good through the ability of theoperator to recover the chair via teleoperation. How-ever, we should emphasize that the scope of testingoutdoors did not encompass the full range of envi-ronmental conditions anticipated during ATRS oper-ations. Additional outdoor trials are planned over thecoming months, which will help to more fully charac-terize the ATRS operational envelope.

8.3. Video Supplements

Several videos from ATRS outdoor testing, the WCDdemonstration, the proof of concept demonstration,etc., can be viewed online at the project webpagehttp://vader.cse.lehigh.edu/projects/atrs/.

9. DISCUSSION

The primary objective of this work was to developa reliable, robust means for autonomously docking awheelchair onto a lift platform to eliminate the needfor an attendant. Ultimately, this was accomplishedthrough LIDAR-based localization and a hybrid con-trol design. Under normal conditions, the localiza-tion paradigm achieved subcentimeter positional ac-curacy. It has also proven to be robust in heavy rain,as well as to significant damage to the retroreflectortargets.

In parking areas conforming to the accessibilitystandards of the ADA, the overall system has provento be reliable in outdoor testing to date. However,operations in environments that significantly deviatefrom these standards can cause issues. On surfaceswith gravel or sand, significant wheel slippage hasbeen observed. We are considering the integration ofa gyroscope on the production system to detect theseoccurrences. On surfaces that deviate significantlyfrom the ground-plane assumption, the LIDAR scanmay miss the retroreflectors completely. The opera-tional envelope in such areas is a function of the fidu-cial size. Unfortunately, growing the cylinder heightsignificantly beyond the present configuration begins

Journal of Field Robotics DOI 10.1002/rob

Gao et al.: Autonomous Docking of Smart Wheelchair for ATRS • 221

Figure 21. (Clockwise from upper left): Docking trials with vehicle exhaust for laser interference and the lift platformelevated, on broken asphalt, and on a sand and gravel surface. The wheelchair successfully docked in each of these trials.

to compromise the aesthetics of the wheelchair. Thisis a significant design consideration, as ATRS willeventually become a commercial product. To ac-commodate a larger operational envelope, we arecurrently investigating two enhancements. The firstis dynamically regulating the LIDAR tilt angle toaccommodate deviations from the ground-planeassumption. The second is a structured lightingsolution with a significant vertical field of view (e.g.,60 deg). Although our previous work with passive vi-sion systems identified limitations in this application(Sermeno-Villalta & Spletzer, 2006), we expect thatthis active vision system paradigm will address thesignal-to-noise issue associated with segmenting thewheelchair features.

We are also investigating reviewer suggestionsfor improving PID performance. System-level testingto date has examined road surfaces ranging from a“like new” parking lot to broken asphalt, gravel, andsand. Whereas docking performance has been accept-able, we have observed conditions in which the mo-tor controllers fail to achieve velocity setpoints, some-times by a significant margin. This was also identi-

fied as a source of docking failures during reliabilitytesting. We are currently investigating adaptive pa-rameter tuning and/or user input through the com-puter UI to improve motor controller performance.Additional reviewer comments regarding the poten-tial for LIDAR dazzle at sunrise/sunset are also beinginvestigated.

ATRS has the potential to be one of the firstwidespread applications of mobile robotics outdoorsthat operate in the vicinity of and in service to people.This is made possible by having a limited and well-defined requirement for autonomous operations. Italso relies on a HRI model that leverages both hu-man decision making and the accurate automationcapabilities of ATRS. In this “supervised autonomy”approach, the operator provides a safety margin forATRS operation in instances when the system is un-certain how to proceed and for docking recovery. Al-though not the focus of this paper, HRI aspects arekey to system robustness and a primary enabler ofATRS commercialization. We expect that a similarmodel will be followed for the foreseeable future tofacilitate human-robot integration.

Journal of Field Robotics DOI 10.1002/rob

222 • Journal of Field Robotics—2008

ACKNOWLEDGMENTS

Special thanks to the entire ATRS Team, especiallyMike Martin and Tom Panzarella, Sr. (Cook Technolo-gies), and Humberto Sermeno-Villalta (University ofSan Salvador) for his early work on the system. Also,thanks are due the reviewers for providing valuablesuggestions to improve both the paper and thesystem itself. Our research results are based on worksupported by the National Science Foundation Part-nerships for Innovation (PFI) Program under GrantNo. 0650115. Any opinions, findings, and conclusionsor recommendations expressed in this material arethose of the author(s) and do not necessarily reflectthe views of the National Science Foundation. Thisproject was also funded in part by a grant from theCommonwealth of Pennsylvania, Department ofCommunity and Economic Development.

REFERENCES

28 CFR Part 36 (1994). ADA Standards for Accessibile De-sign. U.S. Department of Justice.

Braun Corporation (2006). Products: ChairTopper.http://www.braunmobility.com.

Deluca, A., Oriolio, G., & Samson, C. (1998). Feedback con-trol of a nonholonomic car-like robot. In Robot motionplanning and control (pp. 171–253). Springer-Verlag.

Dissanayake, M. W. M. G., Newman, P., Clark, S., Durrant-Whyte, H. F., & Csorba, M. (2001). A solution to thesimultaneous localization and map building (SLAM)problem. IEEE Transactions on Robotics and Automa-tion, 17(3), 229–241.

Fusiello, A., Trucco, E., Tommasini, T., & Roberto, V. (1999).Improving feature tracking with robust statistics.Pattern Analysis and Applications, 2, 312–320.

Gao, C., I. Hoffman, T. P., & Spletzer, J. (2007). Automatedtransport and retrieval system (ATRS): A technologysolution to automobility for wheelchair users. In Pro-ceedings of the 2007 International Conference on Fieldand Service Robotics (FSR ’07), Chamonix, France.

Gomi, T., & Griffith, A. (1998). Developing intelligentwheelchairs for the handicapped. In Lecture Notes inComputer Science, 1458, 150–178.

Howard, A., Parker, L. E., & Sukhatme, G. S. (2006). Exper-iments with large heterogeneous mobile robot team:Exploration, mapping, deployment and detection. In-ternational Journal of Robotics Research, 25(5), 431–447.

Leonard, J., & Durrant-Whyte, H. F. (1991). Mobile robotlocalization by tracking geometric beacons. IEEETransactions on Robotics and Automation, 7(3), 376–382.

Lingemann, K., H. Surmann, A. N., & Hertzberg, J.(2005). High-speed laser localization for mobile robots.

Journal of Robotics and Automation Systems, 51(4),275–296.

Lionis, G. S., & Kyriakopoulos, K. J. (2002). A laser scannerbased mobile robot SLAM algorithm with improvedconvergence properties (volume 1, pp. 582–587). InProceedings of the 2002 IEEE International Conferenceon Intelligent Robots and Systems.

Miller, D., & Slack, M. (1995). Design and testing of alow-cost robotic wheelchair prototype. AutonomousRobots, 2(1).

National Council on Disabilities (2005). The current stateof transportation for people with disabilities in theUnited States. Washington, DC: National Councilon Disabilities. Available at http://www.ncd.gov/newsroom/publications/2005/current state.htm.

NHTSA (1997). Research note: Wheelchair user injuries anddeaths associated with motor vehicle related incidents.Washington, DC: National Highway Traffic SafetyAssociation. Available at http://www.nrd.nhtsa.dot.gov/Pubs/97.850.pdf.

Oriolo, G., Luca, A., & Vendittelli, M. (2002). WMR controlvia dynamic feedback linearization: Design, imple-mentation and experimental validation. IEEE Transac-tions on Control Systems Technology, 10(6), 835–852.

Parikh, S., Grassi, V., Kumar, V., & Okamoto, J. (2004). In-corporating user inputs in motion planning for a smartwheelchair (volume 2, pp. 2043–2048). In Proceedingsof the IEEE International Conference on Robotics andAutomation (ICRA), New Orleans, LA.

Parikh, S., Rao, R., Jung, S., Kumar, V., Ostrowski, J.,& Taylor, C. (2003). Human robot interaction andusability studies for a smart wheelchair (pp. 3206–3211). In Proceedings of the IEEE International Confer-ence on Robotics and Automation (ICRA), Las Vegas,NV.

Pennsylvania Rehabilitation Council (2006). PARC annualreport: Position papers. http://www.parac.org.

Sermeno-Villalta, H., & Spletzer, J. (2006). Vision-based con-trol of a smart wheelchair for the automated transportand retrieval system. In Proceedings of the 2006 IEEEInternational Conference on Robotics and Automation(ICRA ’06), Orlando, FL.

SICK AG (2003). Technical manual, LMS2xx laser measure-ment systems. Reute, Germany: SICK AG.

Simpson, R., & Levine, S. (1999). Automatic adaptation inthe NavChair assistive wheelchair navigation system.IEEE Transactions on Rehabilitation Engineering, 7(4),443–451.

Stern, S., & Brault, M. (2005). Disability data from theAmerican Community Survey: A brief examination ofthe effects of question redesign in 2003. Washington,DC: U.S. Census Bureau.

Wood, T. (2004). When your plan is a van. Quest—Journalof the Muscular Dystrophy Association, 11(2). Avail-able at http://www.mda.org/publications/Quest/q112vanplan.html.

Yanco, H. (1998). Wheelesley, a robotic wheelchair system:Indoor navigation and user interface. Lecture Notes inArtificial Intelligence: Assistive Technology and Artifi-cial Intelligence, 1458, 256–268.

Journal of Field Robotics DOI 10.1002/rob