Skip to content

Commit 6384e8d

Browse files
committed
feat(test): add more tests to template
1 parent 925eeaf commit 6384e8d

1 file changed

Lines changed: 146 additions & 1 deletion

File tree

source/Contribute/Test_OSB.md

Lines changed: 146 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,12 +8,45 @@ We have marked all tests as passing here as an example.
88
Please add any tests that we have missed.
99
The more complete the test list/matrix, the more robust and reliable OSB will be for its users.
1010

11+
The development deployment is tested before being deployed on the production infrastructure.
12+
The URL for the development deployment is: https://v2dev.opensourcebrain.org
13+
1114

1215
```{code-block} markdown
16+
17+
# Testing template for OSBv2.
18+
19+
- Deployment: development/production
20+
- Date/time:
21+
22+
Statuses:
23+
24+
- PASS: test passes
25+
- FAIL: test fails
26+
- NA: not applicable
27+
28+
1329
## Website loading
1430
1531
- Website loads: PASS
1632
33+
### Services
34+
35+
Note that while everyone can check if these services are up, only admins will be able to login to check logs and so on.
36+
37+
- KeyCloak is up: https://accounts.v2dev.opensourcebrain.org/: PASS
38+
- Argo is up: https://argo.v2dev.opensourcebrain.org/: PASS
39+
- Swagger is up: <url>?
40+
- Sentry is up: <url>?
41+
42+
43+
## Left side bar
44+
45+
- All links are valid and work: PASS
46+
- Workspaces button works: PASS
47+
- Repositories button works: PASS
48+
- "Create new" button shows "login" dialog: PASS
49+
1750
## Usage before signing in
1851
1952
- Featured workspaces load: PASS
@@ -41,6 +74,7 @@ The more complete the test list/matrix, the more robust and reliable OSB will be
4174
- Tag search is marked when active in both views: PASS
4275
- Deslecting tag removes it from search: PASS
4376
- Pagination works: PASS
77+
- Repository entry username is correct: FAIL (capitalised?)
4478
4579
## Authentication
4680
@@ -57,8 +91,119 @@ The more complete the test list/matrix, the more robust and reliable OSB will be
5791
### Login
5892
5993
- Logging in with valid username/password works: PASS
60-
- Logging in with invalid username/passworkd works: PASS
94+
- Logging in with invalid username/password works: PASS
95+
96+
## Logged in user
97+
98+
- New user greeted with "Create your first workspace": PASS
99+
100+
### My account
101+
102+
- Link works and page loads: PASS
103+
- "Manage running workspaces" link works: PASS
104+
- "Edit my profile" button works: PASS
105+
106+
#### Edit my profile
107+
108+
- Profile picture URL addition works: PASS
109+
- Changing display name works: FAIL
110+
- Changing e-mail works: PASS
111+
- Adding links works and profile page is updated: PASS
112+
113+
## Adding new repository
114+
115+
### General
116+
117+
- Invalid repository URL shows error: PASS
118+
- Image upload works: PASS
119+
- Valid repository URL loads metadata:
120+
121+
- GitHub: PASS
122+
- DANDI: FAIL: intermittently fails when URL is pasted
123+
- FigShare: FAIL: unclear what valid FigShare URLs are. Perhaps the error message should specify to help users.
124+
- BioModels: PASS
125+
126+
- Repository is correctly added: PASS
127+
128+
- GitHub: PASS
129+
- DANDI: FAIL: intermittently fails when URL is pasted
130+
- FigShare: NA
131+
- BioModels: PASS
132+
133+
- Repository listed in user page under repositories tab: PASS
134+
135+
- GitHub: PASS
136+
- DANDI: FAIL: intermittently fails when URL is pasted
137+
- FigShare: NA
138+
- BioModels:
139+
140+
- Repository duplication is avoided: PASS: looks like one can add duplicates
141+
142+
143+
## Repository detail page
144+
145+
146+
- File list loads correctly:
147+
148+
- GitHub: PASS
149+
- DANDI: PASS
150+
- FigShare: NA
151+
- BioModels: PASS
152+
153+
154+
## Workspace creation
155+
156+
### From repository
157+
158+
- New workspace from selection works: without selections:
159+
160+
- GitHub: PASS
161+
- DANDI: UNTESTED (large data files)
162+
- FigShare: NA
163+
- BioModels: PASS
164+
165+
- New workspace from selection works: with selections:
166+
167+
- GitHub: PASS
168+
- DANDI: UNTESTED (large data files)
169+
- FigShare: NA
170+
- BioModels: PASS
171+
172+
- Workstation files are downloaded correctly
173+
174+
- GitHub: PASS
175+
- DANDI: UNTESTED (large data files)
176+
- FigShare: NA
177+
- BioModels: FAIL (needs more testing: file list was present, but not the file)
178+
179+
180+
- New workspace from selection: workspaces are private by default: PASS
181+
- Private workspaces are clearly marked: FAIL (no indicator that a workspace is private?)
182+
183+
### Not from repository
184+
185+
- New workspace can be created for JupyterLab: PASS
186+
- New workspace can be created for NetPyNE-UI: PASS
187+
- New workspace can be created for NWBE: PASS
188+
189+
## Applications
190+
191+
- Left side bar works: PASS
192+
- Resources appear in left hand side bar: PASS
193+
194+
### JupyterLab
195+
196+
- JupyterLab loads correctly: PASS
197+
198+
### NWB Explorer
199+
200+
- NWBE loads correctly: PASS
201+
- Clicking on acquisition/stimulus opens plots: FAIL (needs to be checked on prod)
61202
203+
### NetPyNE-UI
62204
205+
- NetPyNE-UI loads correctly: PASS
206+
- Examples are loaded correctly: PASS
207+
- NetPyNE-UI works correctly: PASS (tested with first example)
63208
64209
```

0 commit comments

Comments
 (0)