General Preferences - Test Suite
Note
Tester |
Test Date |
Scopy version |
Plugin version (N/A if not applicable) |
Comments |
---|---|---|---|---|
Setup environment:
- M2K.emu:
Press the add device button
Enable emulator for adalm2000
Verify and add device with M2KPlugin and ADCPlugin enabled
- Pluto.emu:
Press the add device button
Enable emulator for pluto
Verify and add device with ADCPlugin enabled
- Pluto.usb:
Connect a pluto device via usb to your PC
Connect to the device in Scopy with ADCPlugin enabled
Test 1 - Save/Load Scopy session
UID: TST.PREF.SAVE_LOAD_SESSION
Description: Manage sessions to retain or load overall application states (only applies to plugins which have this implemented).
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ALL
- Steps:
Set preference to enabled
Open Oscilloscope tool
Modify the time base value to 1s
Close Scopy
- Open the app using the same setup and check if the time base
Expected result: time base is 1s
Actual result:
- Redo all the steps with the preference disabled
Expected result: time base is the default value
Actual result:
- Press the “Settings file location” open button within the preference menu
Expected result: should open a file browser containing .ini files for every plugins’ session saved
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 2 - Double click to attach/detach tool
UID: TST.PREF.DOUBLECLICK_ATTACH_DETACH
Description: Tools can be detached from the main window by double clicking them in the left menu.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ALL
- Steps:
Set preference to enabled.
- Double click Oscilloscope tool to detach it.
Expected result: Oscilloscope tool should detach from the main window into a new one.
Actual result:
- Redo all the steps with the preference disabled.
Expected result: Nothing should happen.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 3 - Save/Load tool attached state
UID: TST.PREF.SAVE_LOAD_TOOL_STATE
Description: Manage sessions to retain tool attached states.
- Test prerequisites:
Emulator tests
Depends on Test Double click to attach/detach tool
- Preconditions:
OS: ALL
- Steps:
Set the following preferences to enabled: Save/Load tool attached state and Double click to attach/detach tool.
Double click Oscilloscope tool to detach it.
Close Scopy.
- Open the app using the same setup.
Expected result: Oscilloscope is still detached.
Actual result:
- Redo all the steps with the Save/Load tool attached state preference disabled.
Expected result: Oscilloscope should not be detached.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 5 - Enable OpenGL plotting
UID: TST.PREF.ENABLE_OPENGL_PLOTTING
Description: Use GPU acceleration for rendering plots (OpenGL-based).
- Test prerequisites:
Emulator tests
Depends on Test “Plot FPS”
- Preconditions:
OS: ALL
- Steps:
Set preference to enabled.
Set Debug preference “Show plot FPS” to enabled.
- Open Oscilloscope tool and run it.
Expected result: The red text inside the plot should contain “OpenGL rendering.”
Actual result:
- Redo all the steps with the preference disabled.
Expected result: The red text inside the plot should contain “Software rendering.”
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 7 - Enable the status bar for displaying important messages
UID: TST.PREF.ENABLE_STATUS_BAR
Description: Show status messages on the bottom of the app window.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps
Set preference to enabled.
- Do the setup again and look for a message bar when pressing “connect.”
Expected result: A message about connecting should appear at the bottom of the window.
Actual result:
- Redo all the steps with the preference disabled.
Expected result: No message should pop up.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 8 - Show Grid
UID: TST.PREF.SHOW_GRID
Description: Display grid lines for better visual referencing on plots.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps:
Set preference to enabled.
- Open ADC - Time tool.
Expected result: A grid should be visible on the plot.
Actual result:
- Redo all the steps with the preference disabled.
Expected result: No grid on the plot.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 9 - Show Graticule
UID: TST.PREF.SHOW_GRATICULE
Description: Display lines for axes centered on 0 points on plots.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps:
Set preference to enabled.
- Open ADC - Time tool.
Expected result: A horizontal and a vertical measurement line should be centered on the 0-axis points (both may not be visible at the same time).
Actual result:
- Redo all the steps with the preference disabled.
Expected result: The lines should border the entire plot instead of centering on 0 points.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 10 - Use Lazy Loading
UID: TST.PREF.USE_LAZY_LOADING
Description: Load IIO resources as needed to improve initial load performance.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: Windows
- Steps:
Set preference to enabled.
Open Scopy console executable.
After connecting to Pluto as described in the setup, look in the console for “device connection took:” times.
Redo all the steps with the preference disabled and compare the elapsed times.
Expected result: Elapsed times connecting to some plugins should be lower when lazy loading is enabled.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 11 - Use native dialogs
UID: TST.PREF.USE_NATIVE_DIALOGS
Description: Use system-native dialog windows.
- Preconditions:
OS: ALL
- Steps:
Set preference to enabled.
- Press the Load button on the left menu.
Expected result: A native file browser window should open. A native file dialog is the file chooser that is provided by the operating system.
Actual result:
- Redo all the steps with the preference disabled.
Expected result: A non-native, Scopy-specific, file browser window should open.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 12 - Auto-connect to previous session
UID: TST.PREF.AUTO_CONNECT_PREVIOUS_SESSION
Description: Automatically reconnect to the last used devices on startup.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps:
Set preference to enabled.
Connect to the device and then close the application.
- Open Scopy.
Expected result: Scopy should automatically connect to the Pluto device.
Actual result:
- Redo all the steps with the preference disabled.
Expected result: Should not connect automatically.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 13 - Font scale
UID: TST.PREF.FONT_SCALE
Description: Adjust font size within the app (this is experimental, so some layout artifacts may appear).
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps:
- Set preference to 1.45, restart Scopy, and inspect some tools.
Expected result: All app text and some buttons should be larger.
Actual result:
- Repeat the steps for font size 1.
Expected result: Text should return to default size.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 14 - Theme
UID: TST.PREF.THEME
Description: Change application theme.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps:
- Set preference to a Harmonic light theme and restart the application.
Expected result: Application should be displayed in a light theme while retaining the same UX and usability in all tools.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 15 - Language
UID: TST.PREF.LANGUAGE
Description: Change the language of the application interface.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps
- Set preference to a different language and restart the app.
Expected result: Some text language should change in the M2K tools.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 16 - Connect to multiple devices
UID: TST.PREF.CONNECT_MULTIPLE_DEVICES
Description: Enable connections to multiple hardware and emulator
- Test prerequisites:
Emulator tests
- Preconditions:
- Steps:
Set preference to enabled.
- Connect to 2 devices following the setup.
Expected result: Two devices should appear in the left menu and be fully functional.
Actual result:
- Repeat the steps with the preference disabled.
Expected result: When connecting to the second device, the first one should automatically disconnect.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 17 - Regularly scan for new devices
UID: TST.PREF.REGULARLY_SCAN_NEW_DEVICES
Description: Continuously scan and recognize newly connected devices.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps:
Set preference to enabled.
- Connect the Pluto to the machine via USB.
Expected result: Pluto should automatically appear in the device list, and a toggle switch for scanning should appear in the top right.
Actual result:
- Repeat the steps with the preference disabled.
Expected result: Pluto should not appear automatically, only when pressing the on-demand Scan button.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 18 - Session devices
UID: TST.PREF.SESSION_DEVICES
Description: Automatically connect to saved devices.
- Preconditions:
“Auto-connect to previous session” preference needs to be enabled
OS: ANY
- Steps:
After connecting to Pluto, go to the preferences and press “Refresh.”
Check the current device’s URI.
Go back to the homepage and forget the device by pressing the red “X” button on the device.
- Close and reopen Scopy.
Expected result: Should automatically connect to the URI you checked.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 19 - Show plot FPS
UID: TST.PREF.SHOW_PLOT_FPS
Description: Show FPS on plots.
- Test prerequisites:
Emulator tests
- Preconditions:
- Steps:
Set preference to enabled.
Open Oscilloscope and run it.
- Open ADC - Time and run it.
Expected result: Should show the FPS on the plot (M2K may look different from other plugins).
Actual result:
- Repeat the steps with the preference disabled.
Expected result: No FPS should be visible.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 20 - Plot target FPS
UID: TST.PREF.PLOT_TARGET_FPS
Description: Manage the maximum FPS plots should run at (this may also affect the IIO acquisition).
- Test prerequisites:
Emulator tests
- Preconditions:
“Show plot FPS” needs to be enabled.
OS: ANY
- Steps:
- Set the preference to each value and run ADC - Time to check FPS.
Expected result: Plot FPS should be capped at the selected value.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL
Test 21 - Reset settings and plugins to default
UID: TST.PREF.RESET_SETTINGS_DEFAULT
Description: Resets all settings and plugins to default values.
- Test prerequisites:
Emulator tests
- Preconditions:
OS: ANY
- Steps:
Change general preferences and M2K preferences.
- Press the “Reset” button and the “Restart” to restart the app.
Expected result: All changed preferences should have the default values.
Actual result:
Tested OS:
Comments:
Result: PASS/FAIL