Reviews From Web ratings measurement
This task is to measure the quality of Reviews From Web feature. Reviews from web is basically the
rating score from a website of a local business. The measurement includes the quality of links, rating
score and rating value. Please follow the steps below to answer the questions.
Please complete the link test through Part 1 firstly. If the test result is that you do not need to quit,
congratulations, you can start on this task, please follow the instructions in Part 2 to complete the hits.
Part A. Check your permission
This HitApp requires you have access to these websites firstly. Otherwise, pls exit, you are not fit for this
task.
1. Types of links you will meet. Pls click all the links and check if you could access them.
Note: If the web server you are using located in the US, congratulations, you can access most
links directly, if it is not located in the US, we recommend that you use a remote server or use a
VPN that server located in the US, otherwise your access may be limited.
Facebook Link: https://www.facebook.com/checkpoint/disabled/?next=https%3A%2F
%2Fwww.facebook.com%2Fenapak.com.my%2Fposts
Yelp Link: COURIER-JOURNAL MEDIA - 525 West Broadway, Louisville, KY - Yelp
Zocdoc Link: Dr. Bertha Baum, DO, Hallandale Beach, FL | Dermatologist (zocdoc.com)
YellowPages Link: Enterprise Rent-A-Car - Berkeley, CA 94704 (yellowpages.com)
Homedepot Link: Access Denied (homedepot.com)
2. What kind of situation means you cannot access?
2.1) If you visit a link (e.g. Facebook), the page pops up the words "You need to log in", and after
you log in with your account, the page pops up “your account has been disabled” as shown in
the following highlight.
2.2) If you visit a link (e.g. Yelp, Zocdoc), the page shows "You do not have permission to access"
2.3) If you visit a link (e.g. Homedepot), and make sure your VPN is turned on, the page shows
“Access Denied” and the details are “You don’t have permission to access…” as shown in the
following highlight.
Display of link page Explanation
No permission, you
could try to clear the
cache. After that, if you
still see this display, that
means you cannot
complete our the task,
you need to exit.
3. The following situations may be confused you, you could use the description of “Explanation”.
3.1) If you cannot open link, and the page shows as below, you may need to make sure your VPN is
turned on, and clear the cache. After that, you could access successfully.
Display of link page Explanation
No permission, but in this special
case, you need to skip this hit
directly. You could continue working
on the other hits.
You may need to make sure your VPN
is turned on, and clear the cache.
After that, you could access
successfully.
You may need to make sure your VPN
is turned on, and clear the cache.
After that, you could access
successfully.
Part B. If you have access to all the links in Part A, you can start doing hits. The
specific operation guidelines are as follows, please read them carefully.
In total we have 4 questions, but they are not all available according to your answers. You should
answer all of the questions shown and submit your answers.
1. Confirm the local business’ information. There is a `Business info` section listed in the task page
which gives the business name, address, business website link.
4. Right click on the Rating link and open the page in a new tab.
5. Go to the page and verify the link is valid and shows exactly the same business as what we
have above. Verify both the name and address of the business.
6. The following is the whole 4 questions which needs to be answered. After answering one
question, the next question will be displayed according to your choice, or a submit button
will be displayed.
Note: You’d better open the Rating Link firstly, you could see a new page in a new tab. If the
page shows you do not have permission to access the Rating Link page, which means that you
cannot answer all the questions below, please click Skip button to skip this HIT and start the next
HIT.
7. Steps and detailed explanation:
5.1)Answer the 1st question.
Note:
1)Please ensure the accuracy of your answer, otherwise, the system will ban maliciously
submitted illegal operations.
e.g.
a. If the Url link is not valid (404), choose ` The page is not available
(shows page error rather than you don't have permission to
access the page). `
b. If the business from the link doesn’t match with the one shown above in the
business info, choose ` No, url link website doesn't match the
business`
c. If the business matches with the one shown in the business info, choose ` Yes, it's
the same.`
If you select ` Yes, it's the same.`, you will see the 2nd question. If select other two options, you
can submit directly.
5.2)Answer the 2nd question.
Go through the Rating Link page and see if you can find any ratings of the local business. What
you need to look for is rating value and rating count. For example, the circle marked in the
picture shows where the rating value and rating count exists.
5.3)Answer the 3rd question.
Note:
1) Our scaling is x out of 5.
2) Only when you select from the first or second option of question 2 will you see the question
3.
3) Taking the 5-point system as an example, on the Rating Link page, if we see the rating star
rating of 0.5 up and down is allowed to float.
Continue to go through the Rating Link page,
A is the rating value which is 4 out of 5 which matches the
B is the rating count which is 3.
These are matching with what we have in the question info:
So you can choose `Yes`. It means both the rating value and rating count are close to the ones
on the url page.
Note:
1) The rating value in our scaling is 5. For example if web page is showing 8 out of 10 here
whereas from what we provided it’s showing 4 out of 5. In this case we should consider the
rating count as match.
5.4)Answer the 4th question.
Note:
1) Only when you select the first or third option of question 2 will you see question 4.
The rating count can be read from text marked with B. You should decide whether the rating
count you see from the link page is within the given range (inclusive). For example here 3 is with
in range 2~4, then you should select ‘Yes’, it means count is close to the one on the url page.
Otherwise you should select ‘No’, It means rating count is not close to the one on the url page.
6. Submit and Skip operation.
Submit your answer by clicking Submit button.
If you meet with problems submitting your answer or not clear about the answer, you can click on
the Skip button.
7. If you encounter unexpected problems, or have some suggestions, you can click the "Report a
technical issue" button in the upper right corner of the page and fill in the feedback to contact us.
