@@ -8,12 +8,45 @@ We have marked all tests as passing here as an example.
88Please add any tests that we have missed.
99The more complete the test list/matrix, the more robust and reliable OSB will be for its users.
1010
11+ The development deployment is tested before being deployed on the production infrastructure.
12+ The URL for the development deployment is: https://v2dev.opensourcebrain.org
13+
1114
1215``` {code-block} markdown
16+
17+ # Testing template for OSBv2.
18+
19+ - Deployment: development/production
20+ - Date/time:
21+
22+ Statuses:
23+
24+ - PASS: test passes
25+ - FAIL: test fails
26+ - NA: not applicable
27+
28+
1329## Website loading
1430
1531- Website loads: PASS
1632
33+ ### Services
34+
35+ Note that while everyone can check if these services are up, only admins will be able to login to check logs and so on.
36+
37+ - KeyCloak is up: https://accounts.v2dev.opensourcebrain.org/: PASS
38+ - Argo is up: https://argo.v2dev.opensourcebrain.org/: PASS
39+ - Swagger is up: <url>?
40+ - Sentry is up: <url>?
41+
42+
43+ ## Left side bar
44+
45+ - All links are valid and work: PASS
46+ - Workspaces button works: PASS
47+ - Repositories button works: PASS
48+ - "Create new" button shows "login" dialog: PASS
49+
1750## Usage before signing in
1851
1952- Featured workspaces load: PASS
@@ -41,6 +74,7 @@ The more complete the test list/matrix, the more robust and reliable OSB will be
4174- Tag search is marked when active in both views: PASS
4275- Deslecting tag removes it from search: PASS
4376- Pagination works: PASS
77+ - Repository entry username is correct: FAIL (capitalised?)
4478
4579## Authentication
4680
@@ -57,8 +91,119 @@ The more complete the test list/matrix, the more robust and reliable OSB will be
5791### Login
5892
5993- Logging in with valid username/password works: PASS
60- - Logging in with invalid username/passworkd works: PASS
94+ - Logging in with invalid username/password works: PASS
95+
96+ ## Logged in user
97+
98+ - New user greeted with "Create your first workspace": PASS
99+
100+ ### My account
101+
102+ - Link works and page loads: PASS
103+ - "Manage running workspaces" link works: PASS
104+ - "Edit my profile" button works: PASS
105+
106+ #### Edit my profile
107+
108+ - Profile picture URL addition works: PASS
109+ - Changing display name works: FAIL
110+ - Changing e-mail works: PASS
111+ - Adding links works and profile page is updated: PASS
112+
113+ ## Adding new repository
114+
115+ ### General
116+
117+ - Invalid repository URL shows error: PASS
118+ - Image upload works: PASS
119+ - Valid repository URL loads metadata:
120+
121+ - GitHub: PASS
122+ - DANDI: FAIL: intermittently fails when URL is pasted
123+ - FigShare: FAIL: unclear what valid FigShare URLs are. Perhaps the error message should specify to help users.
124+ - BioModels: PASS
125+
126+ - Repository is correctly added: PASS
127+
128+ - GitHub: PASS
129+ - DANDI: FAIL: intermittently fails when URL is pasted
130+ - FigShare: NA
131+ - BioModels: PASS
132+
133+ - Repository listed in user page under repositories tab: PASS
134+
135+ - GitHub: PASS
136+ - DANDI: FAIL: intermittently fails when URL is pasted
137+ - FigShare: NA
138+ - BioModels:
139+
140+ - Repository duplication is avoided: PASS: looks like one can add duplicates
141+
142+
143+ ## Repository detail page
144+
145+
146+ - File list loads correctly:
147+
148+ - GitHub: PASS
149+ - DANDI: PASS
150+ - FigShare: NA
151+ - BioModels: PASS
152+
153+
154+ ## Workspace creation
155+
156+ ### From repository
157+
158+ - New workspace from selection works: without selections:
159+
160+ - GitHub: PASS
161+ - DANDI: UNTESTED (large data files)
162+ - FigShare: NA
163+ - BioModels: PASS
164+
165+ - New workspace from selection works: with selections:
166+
167+ - GitHub: PASS
168+ - DANDI: UNTESTED (large data files)
169+ - FigShare: NA
170+ - BioModels: PASS
171+
172+ - Workstation files are downloaded correctly
173+
174+ - GitHub: PASS
175+ - DANDI: UNTESTED (large data files)
176+ - FigShare: NA
177+ - BioModels: FAIL (needs more testing: file list was present, but not the file)
178+
179+
180+ - New workspace from selection: workspaces are private by default: PASS
181+ - Private workspaces are clearly marked: FAIL (no indicator that a workspace is private?)
182+
183+ ### Not from repository
184+
185+ - New workspace can be created for JupyterLab: PASS
186+ - New workspace can be created for NetPyNE-UI: PASS
187+ - New workspace can be created for NWBE: PASS
188+
189+ ## Applications
190+
191+ - Left side bar works: PASS
192+ - Resources appear in left hand side bar: PASS
193+
194+ ### JupyterLab
195+
196+ - JupyterLab loads correctly: PASS
197+
198+ ### NWB Explorer
199+
200+ - NWBE loads correctly: PASS
201+ - Clicking on acquisition/stimulus opens plots: FAIL (needs to be checked on prod)
61202
203+ ### NetPyNE-UI
62204
205+ - NetPyNE-UI loads correctly: PASS
206+ - Examples are loaded correctly: PASS
207+ - NetPyNE-UI works correctly: PASS (tested with first example)
63208
64209```
0 commit comments