Andrijana M.
Good for very occasional gigs and without much expectations
There are few things to have in mind with it which makes it more flexible than other platforms, but at the same time I found them technically and operatively rigid in some ways. PROS First of all, I did not have to pass a demo test, like other platforms require you to pass. With Userlytics you just sign up and you are a tester and that is great. Second of all, while most platforms require 2-3 weeks to process the acceptance of the test and the payment should you succeed, in the case of Userlytics it is 10 days, which is also amazing. Trymata was at a time even shorter than a week, but those days are gone now. Thirdly, they pay in Euros and Dollars, let us say equally often you will get tests in both currencies, which is great for all European testers, not so great for the UK testers on the other hand. Still, this is flexible enough for the time being. Fourthly, they have a variety of studies paying different amounts of money, including ones being done briefly on either device in the form of a written survey, paying out 3 or 5 $/€, where you do not have to voice out you thoughts. Fifthly, it takes them usually less than 24 hours to approve or reject a test, which is good, because you know whether you can count on that money or not. CONS Pretty much only operates decently on Google Chrome when on a desktop device. Mozilla is not supported, Microsoft Edge is not really a go-to browser for a lot of users and unfortunately, Google Chrome, nowadays is causing a lot of issues on many aspects and is also a mandatory browser for other platforms (non-testing platforms) that necessarily exclude the usage of any plugin or extensions that is mandatory for performing tests on Userlytics, or any other testing platform. Secondly, they reject tests more often with not so supportive arguments on every occasion, or without a message at all. They can say that you did not perform all the tasks or that you did not dedicate them enough time or spoke about the reasons in enough details but that is not always possible for many different reasons, for instance the lack of the time, which leads to my 3rd negative point. Most talk-out-loud 10$/€ studies are limited to only 30 minutes and it is impossible to go through all the tasks with enough details, sometimes not even through half of them, as there can be 20 to 30 tasks, or even more. I think that is a lot of work for a relatively small payment, as in comparison, on Intellizoom you get 8$ and some studies are really 5 to 10 minutes tops, whereas others turn out to be even shorter. I found those times when I was short of time quite stressful and exhausting, regardless of the fact they paid me. Fourthly, they are the only ones that I know that in their invitation and confirmation email for the live conversation state they you must have headphones, and you do not really need them as long as you have functioning microphone and speakers, as the speaker on the other side will rarely have them either. Fifthly, I was rejected the payment for one live conversation, with the reasoning that my connection was poor and under-standardised, and that the problem with sound transmission was on my side due to that lack of stability in connection. The customer support team stated they could hear the other side perfectly while assessing the test, when I could not hear it, and that I should guarantee the broadband connection of 300K bitrate for live conversations. In my case I am not in a position to get higher internet speed offering better bitrates, as the providers for the postcode where I live are limited and my own provider is already giving me the top speed available for my location. I think it is unfair to come with the explanation demanding something like that without previously stating in the test invitation that such parameter is vital for the live conversation. It should be stated really if they claim that such minimum is mandatory. The mobile app is not really great. I tried uninstalling and installing and updating but it would not load the dashboard properly and it would not show the pending, approved and rejected tests on it at all. It gets stuck loading in a loop. I do mobile tests by starting them on the desktop and then by copying the passcode onto my mobile app and initiating the test by selecting the “Start test with a Code” option that opens upon clicking the upper left drop-down menu. In the last place, Userlytics will not send you test invitations daily. The tests sometimes come once a week or more seldom. Sometimes you will be getting daily an invitation for the same test that you will have turned out to be an unsuitable candidate for in the pre-screening questions, while answering the first survey for the test, yet your answers from the initial screener will not be recognised and you will have to go all the way until the “Sorry message” screen.
Response from UserlyticsSep 24, 2024
HI, Thank you for providing such detailed feedback and for highlighting both the positive and negative aspects of your experience with Userlytics. We appreciate your thoughtful insights, as they help us to continuously improve the platform for our testers. We’re glad to hear that you found our sign-up process, payment timelines, and currency flexibility beneficial. It’s also encouraging to know that you’ve had positive experiences with the variety of studies available and the quick turnaround on test approvals. Regarding the areas of improvement you mentioned, we’re taking your feedback seriously: 1. Browser Compatibility: While we do recommend Google Chrome for optimal performance, we understand the need for broader browser support and are continually working to improve functionality across different platforms. 2. Test Rejections: We apologize if some test rejections were not communicated clearly. We’re working to ensure that all feedback is transparent and provides actionable reasons for rejection. 3. Task Time Limit: We understand that some tests can be time-sensitive and that it may be difficult to complete them within the allotted timeframe. We are always looking for ways to improve the balance between task requirements and time limits. 4. Headphone Requirement for Live Conversations: We will look into clarifying this requirement in our communications to make the process smoother and more consistent for testers. 5. Connection Issues in Live Tests: We’re sorry to hear about the challenges you faced with your internet connection during a live session. While we try to provide as much guidance as possible, we appreciate your suggestion to clarify the necessary technical requirements in advance. 6. Mobile App: We understand your frustrations with the app, and our team is working to resolve these technical issues to ensure a smoother experience for mobile testers. 7. Test Availability: While test availability can vary based on client needs, we’re working to improve the frequency and relevance of test invitations so that testers are matched more effectively. Thank you again for your feedback. We’re committed to enhancing our platform and your input is invaluable in helping us improve. If you have any further concerns, feel free to reach out to us at [email protected], and we’ll be happy to assist you. Best regards, The Userlytics Team