Usability TestRealty Websitesby Tim Slippy

IntroductionThe purpose of this white paper is to compare the usability of two Real Estate websites available online. The sites tested were Zillow and Trulia. I tested these sites as if I were a college student who was just graduating and wanting to move to Seattle, WA. These sites were listed as the top two of 15 real estate websites by an easily found online article, and both were suggested by a friend. Both are free to use, have very similar features, and are very comparable. In this paper, I assume users will know how to navigate a typical website and use an internet browser.

Methods: How the tests were performed.The usability tests were performed during the weekend at nearly the same time of day on Saturday and Sunday. Variables, such as amount of sleep, food eaten, etc were constrained to be as close to each other for each test. The tests were conducted online using Google Chrome version 42, and were recorded using Open Broadcasting Software, a free streaming/recording tool. I used recordings because it allowed me to review what I did and what my thought process was. This was very valuable to me in order to later complete this analysis.Several tasks were chosen to test the real estate sites with. The tasks I chose were based on what I as a college student would be looking for in a rental in Seattle, WA, as if I would be moving there this summer.Task#:Description1. Area Recommendations2. Graphs of prices available3. Searchable by 2nd Floor or above4. Searchable by Newer than the year 20005. Searchable by Internet availability6. Searchable by Rental Rates7. Ability to find Expert/Region-specific advice8. Searchable by Views of the city9. Pictures of the living space10. Smoking Policies11. Nearby Amenities: Bike TrailCriteria: How the tests were evaluated.Each task was evaluated by three, five-point Likert Scales in the form of the following statements:There was a specific tool for the task.I was able to complete the task.The results of the task were satisfactory.Each of the statements were evaluated by the degree that I agreed with the statements:5: Strongly Agree 4: Agree 3: Neutral2: Disagree1: Strongly Disagree

Captures: Screenshots comparing each site.Each test may have screenshots for displaying the information that was found, and how the two websites compare.

Results: Test results and analysis.Each task has a Likert Scale, and is displayed as follows:Likert Scale:

Strongly AgreeAgreeNeutralDisagreeStrongly Disagree

There was a specific tool for the task.

I was able to complete the task.

The results of the task were satisfactory.

Example Likert Table.Task 1: Area RecommendationsEach site had areas for advice. I found different takes on the problem from each site. Only Zillow seemed to have a dedicated advice section were people could ask questions and get answers.Trulia showed graphs of the local area, which was great for getting a general idea of the neighborhood, but not as relevant to the search for specific advice.Picture 1.1 - Zillow

The main difference was reflected in the Likert Scale for this task as shown in Likert Table 1.Picture 1.2 Trulia

There was a specific tool for the task.

ZillowTrulia

I was able to complete the task.

ZillowTrulia

The results of the task were satisfactory.

Zillow / Trulia

Likert Table 1Task 2: Graphs of Prices Available

Each site had excellent graphs of the state of the market around Seattle. The graphs were well laid out and usually easy to understand. Trulias site went above and beyond by providing multiple overlays for different search criteria. Both sites graphs and information were useful and satisfactory.Picture 2.1 ZillowPicture 2.2 - Trulia

There was a specific tool for the task.

Zillow / Trulia

I was able to complete the task.

Zillow / Trulia

The results of the task were satisfactory.

Zillow / Trulia

Likert Table 2Task 3: Searchable by 2nd Floor or aboveBoth Zillow and Trulia have great horizontal searching tools, especially with maps. However, both sites are vertically challenged and do not offer a method of searching for which floor ranges are preferred. The main way I determined if a living space was on an upper floor was by the pictures available. See Task 8 and 9 for more information.There was a specific tool for the task.

Zillow / Trulia

I was able to complete the task.

Zillow / Trulia

The results of the task were satisfactory.

Zillow / Trulia

Likert Table 3

Task 4: Searchable by Newer than the year 2000Upon completing this task, some of the major differences between the sites showed up. Zillow had an easy dropdown menu for selecting living spaces ages. Trulia, however, simply did not. The only way to search for the age was to search for a keyword. However, searching for 2000 came up with results including down-payments, square footage, and other statistics not related to age for certain buildings. I did find one built in 2000, but it wasnt easy to get there. In the Trulia picture below, I used Chromes search utility to find the phrase 2000 in the page to confirm it was about the year built.Picture 4.2 - TruliaPicture 4.1 - Zillow

There was a specific tool for the task.

ZillowTrulia

I was able to complete the task.

ZillowTrulia

The results of the task were satisfactory.

ZillowTrulia

Likert Table 4

Task 5: Searchable by Internet AvailableNeither site had a specific tool to search for whether internet was available at the building. The main method of finding buildings with internet resorted to using the keyword search for both sites. Likert Table 5 shows that there wasnt significant difference between the usability of each site for this type of search. The results were satisfactory since it is pretty easy to find internet in Seattle.Picture 5.2 - TruliaPicture 5.1 - Zillow

There was a specific tool for the task.

Zillow / Trulia

I was able to complete the task.

ZillowTrulia

The results of the task were satisfactory.

ZillowTrulia

Likert Table 5

Task 6: Searchable by Rental RatesIt makes sense that both sites have quick access to searching by rental rate. As a college student, I would definitely be looking for a bargain deal, and would not want to spend more than my budget can afford. Using these utilities on each site was easy to find and use.Picture 6.2 - TruliaPicture 6.1 - Zillow

There was a specific tool for the task.

Zillow / Trulia

I was able to complete the task.

Zillow / Trulia

The results of the task were satisfactory.

Zillow / Trulia

Likert Table 6

Task 7: Expert/Region-specific adviceAs it turns out, experts are not usually free. However, both sites have great tools for finding a local agent to help find what I would be looking for. Trulias search included a fee range to search agents by, which was not as satisfactory, since it seems most agents are expensive. Zillows site did not have that feature, but instead allowed me to search by whether I was looking for a rental, or to buy a home; the inference being that a rental agent shouldnt be as expensive.Picture 7.2 - Trulia

Picture 7.1 - Zillow

There was a specific tool for the task.

Zillow / Trulia

I was able to complete the task.

Zillow / Trulia

The results of the task were satisfactory.

ZillowTrulia

Likert Table 7

Task 8: Searchable by Views of the CityNeither site had a specific tool for searching by whether a building has views of the city. For many of the buildings I found on Zillow, there were multiple rooms/apartments available, which I would likely be able to choose from if I was serious about renting. It seemed like this would be a choice that must be made later. Both sites offered pictures of the living spaces and views out their windows, which was the main method I used to complete the task.Picture 8.1 - ZillowPicture 8.2 - Trulia

There was a specific tool for the task.

ZillowTrulia

I was able to complete the task.

Zillow / Trulia

The results of the task were satisfactory.

ZillowTrulia

Likert Table 8Task 9: Pictures of Living SpaceEach site had picture galleries available for each place. This makes sense because of the online nature of realty websites. Both sites got top Likert scores for this. See Task 8 for gallery views.There was a specific tool for the task.

Zillow / Trulia

I was able to complete the task.

Zillow / Trulia

The results of the task were satisfactory.

Zillow / Trulia

Likert Table 9

Task 10: Smoking PoliciesNeither site had a specific tool for this. I had expected this would be more emphasized because signing up for on campus dorms includes a smoking preference selection. Likert Table 10 reflects my disappointment. I remained neutral on the results since it was also possible to search by keyword. There was a specific tool for the task.

Zillow / Trulia

I was able to complete the task.

ZillowTrulia

The results of the task were satisfactory.

Zillow / Trulia

Likert Table 10

Task 11: Nearby AmenitiesOnly Trulia has great ways to search for nearby amenities. Zillow was reduced to only check using keyword search, whereas Trulia had maps and overlay filters readily available that made it easy to visualize available amenities.

Picture 11.2 - Trulia

Picture 11.1 - Zillow

There was a specific tool for the task.

TruliaZillow

I was able to complete the task.

TruliaZillow

The results of the task were satisfactory.

TruliaZillow

Likert Table 11

Recommendation: Use Zillow, Trulia analyzes the neighborhoodZillow is overall the easiest to use and find exactly the home I would be looking for. Zillow most often had the searching tools I was looking for, and was generally more compact in the interface, allowing more room for other important maps or information. For finding that perfect place to live, I recommend Zillow. For getting an idea for the neighborhood and amenities available near your perfect place, Trulia has the tools.

Realty Websites Usability Test Zillow vs. Trulia12