-
-
Notifications
You must be signed in to change notification settings - Fork 85
Guide For Testers
theweavr edited this page Apr 3, 2017
·
5 revisions
So we have at last approached the first beta and that in itself tells us how much testing needs to be done. Here is a list of things that I think are most important to test before releasing.
Note: This list is not ordered, so pick whatever you see fit. Test report (passed or failed) will be written with the entry alongside the number of times it was tested. One entry has to pass at least 3 tests before it is confirmed as "almost" bug-free.
Note 2: It will appreciated if your report the bugs as separate issues.
Note 3: Contribution to fix these issues is very much welcome.
To help you navigate:
- Private Playlists
- Last.fm Scrobbling
- Song Audio Quality
- Prevent Screen Lock
- Song Album Art as Lockscreen Wallpaper
- Shortcuts
- Most Played Songs
- Recently Added Songs
- Themes
- Equalizer
- Search
- Sort & Filter
- Songs Import
- Creation, deletion, renaming of private playlists.
- Addition and deletion of multiple songs in a private playlist.
- Also see if the private playlists need to be more protected. (That's where you can give opinions! 😆)
- Logging in your Last.fm account.
- The player scrobbles when the song finishes so listen to a few songs or just skip to the end to test out whether the player is scrobbling or not.
- Quality of each scrobble. Meaning to see how the song looks in the Last.fm directory after scrobble.
- Your opinion regarding when to scrobble a song is welcome.
- Play a few songs in foreground (with app open on the screen) and then play a few songs in background.
- Play a few songs while browsing through heavy pages.
- Play a few songs while scrolling (can be any type of scrolling.)
- Enable this feature and wait for a few minutes to see if it works, then disable it to see if the screen locks or not.
- Enable & disable this in quick succession and see if that has any effect.
- Load a few songs with album arts and play them one after the other. See if the Lockscreen Wallpaper changes or not.
- I have noticed a slight delay and flicker of wallpaper when unlocking the phone. Would need you to confirm.
- After testing out songs with album arts, test out songs without album arts and see what happens to the lockscreen. Does it revert back to the default wallpaper you picked when enabling this setting?
- Use the shortcuts as frequently as possible and from every page in the player. Note the crashes and report.
- Play a few songs more than a 2 times and then navigate to "Most Played Songs" section and see if all of them were added.
- Your opinion regarding when to increase song play count is also welcome. (Currently its at the very beginning).
- This will require you to adjust your phone/PC date a few times. First add a few songs on default date, then increase the date by 4 days and add a few more songs. Navigate to "Recently Added Songs" and see what songs are there.
- Currently, history of added songs is kept for upto 3 days, so that's what we are testing. (Your opinion, again, is welcome regarding this.)
- Change the theme a few times and see if you can find any thing that is out of place (or color).
- You know what to do.
- This is easy to do. Notice the performance, the duplicacy, and lag of the search results returned.
- Test out each and every property in sort and filter and see how many times it crashes or lags.
- Use the jumplist (click on an alphabet or an album-name to see what I am talking about.)
- Import songs a few times in large and small quantities. Notices the performance, memory allocation, crash during import, and duplicate songs.
- Restart after import and notice the startup time.