![[Solid logo]](https://raw.githubusercontent.com/solid/community-server/main/templates/images/solid.svg)
If you made it here you must already have heard about Solid. This space is home to the SolidOS code. Keep reading if you want to know:
- 🤔 What is SolidOS
- 👩🏽💻 SolidOS technical intro
- 👯 How the SolidOS team works
- 🙋🏻 How you can contribute and help SolidOS thrive
- 🆕 Getting started with the SolidOS code
- 📜 License
- 🎤 Feedback and questions
For experimenting with SolidOS implementations, you can:
- try SolidOS on a test-pod (provider:
https://solidcommunity.net:8443, user and password:test-pod) - take a pod on https://solidcommunity.net or another provider
- check out the SolidOS WebApp
- use as a stand-alone desktop app with Data-Kitchen
If you are looking for something else, let us try and guide you:
- for learning about Solid, read about Solid and visit solidproject.org
- to try out Solid, head over to getting started with Solid
- for how SolidOS works, visit the user guide and SolidOS project Pod
- for how the community works, go over to Solid process
- chat with others about Solid on the forum and on instant chats
- join an event over at Solid events or sign up for the Solid newsletter to not miss any news
- read the Solid community code of conduct at Solid CoC
Further links:
- SolidOS explanation video
- SolidOS goals & roadmap
- SolidOS FAQs
- SolidOS developer guide
- report a problem with SolidOS by creating a git issue
- have a new idea? Create a Solid user story/new idea ticket
- check out the in-progress Solid specification and in-progress Solid specification repo. Find the previous specifications, now outdated but still in use if you work with NSS: https://github.com/solid/solid-spec.
- Glossary of terms frequently used in Solid environment
🌟🌟🌟 SolidOS is an Operating System for Solid. 🌟🌟🌟
Solid is developing into a booming ecosystem which involves specifications 📃, tech stack 🛠, servers 💻, and apps 🕹. We, the SolidOS team, believe that this ecosystem also needs an Operating System.
When you get a new phone, PC, or tablet, they usually come with an operating system that provides some basic functionality to get started and be productive. More importantly, you can personalize your OS to your needs, by installing apps, managing content, and much more.
Solid is not shipped with a piece of hardware (who knows, maybe in the future it will...). For now, you get into the ecosystem once you create a WebID and provision your own personal data store (often called a "Pod") (see getting started with Solid - get a pod). Immediately after getting your new Solid WebID and Pod space, SolidOS is helping you to navigate the Solid ecosystem.
SolidOS is much more. SolidOS showcases the possibility of Solid for the future, by which we mean —
- true data ownership — management of personal data & authorization control
- avoidance of vendor lock-in to services — easy moving to a different Pod or WebID provider
- data reuse between applications — with help of data interoperability and data discoverability
Watch a SolidOS explanation video as part of the Solid World event series.
Take a look at an example: SolidOS project Pod. SolidOS implemented features:
- 📰 create a personal webpage
- 📝 manage your WebID and the data about yourself
- 📝 manage personal data/files on your Pod
- 🤝 directly connect and engage with other people who are part of the ecosystem (add friends, chat, ...)
- 💡 make use of interconnected apps
- 🔧 create your own app with Inrupt's Solid Reach SDK or get inspired from a blog post
- and more (see SolidOS user guide)
Read more about the current SolidOS 🌟 vision, goals 🎯, and roadmap 🚗 on the SolidOS project Pod.
Note: SolidOS is also known under names like (default) Data Browser or Databrowser and at times as mashlib. It depends on which flavour of SolidOS you refer to:
- The SolidOS Databrowser Frontend - a frontend for Solid Servers like solidcommunity.net, represented by this codebase;
- The SolidOS Databrowser Webapp - a stand-alone web app served from mashlib: https://solidos.github.io/mashlib/dist/browse.html;
- The SolidOS Data-Kitchen - a stand-alone desktop app: https://github.com/solidos/data-kitchen;
- The SolidOS software stack - a set of libraries that may be used independently of the databrowser, see next section.
The SolidOS stack contains —
It also makes use of —
Let's take a look at an architecture diagram of SolidOS:
A colorful dependency tree can be seen here:
As you can see, SolidOS is composed of several repositories:
- rdflib.js — Javascript RDF library for browsers and Node.js
- solid-logic — core business logic of SolidOS
- mashlib — a solid-compatible code library of application-level functionality for the world of Solid
- solid-panes — a set of core solid-compatible panes based on solid-ui
- solid-ui — User Interface widgets and utilities for Solid. Building blocks for solid-based apps
In the above diagram, SolidOS is deployed on the Node Solid Server (NSS), but it can also be set up to run on the Community Solid Server (CSS) or on ANY Solid-compliant server. When you download and compile the SolidOS code, an NSS is also installed locally, to have everything ready to develop.
For further details about each GitHub repository, please visit them via the links above for Documentation.
We collect SolidOS code good practices and know how in SolidOS documentation pages.
SolidOS FAQs part of the SolidOS developer guide also contains some Q&A and technical troubleshooting infos.
First and foremost who are the contributors of SolidOS?
The SolidOS codebase has a long history and there have been a lot of contributors over the years (see: GitHub contributors). The most active team members are mentioned in the SolidOS Team on the SolidOS Pod Contacts.
The SolidOS team meets every week for a 1h touchdown. We discuss what was done over the past week, what needs to be done next, and delegation of tasks. Find the meeting time and link on the SolidOS project Pod.
We take minutes on our meetings. You can find them on the SolidOS pod.
In between team meetings, we avidly communicate over at the gitter SolidOS channel. Drop by to chat with us, ask questions, or simply say "Hi".
Sometimes some ideas need an incubation period and further discussion. We make use of GitHub discussions for that.
For daily tasks, we have a task overview, as well as a GitHub prioritization board with an overview of needed PRs.
For a longer term roadmap, we use a Solid task manager, and plan the next milestones on Kanban.
- Find answers over at SolidOS FAQs or at the SolidOS developer guide.
- For an overall description of how the whole ecosystem works head over to solid process.
- Make sure to get into discussions on the forum and on Solid instant chat channels.
- Join an event over at Solid events or sign up for the Solid newsletter to not miss any news
- Read the community code of conduct Solid CoC.
The SolidOS team is always looking for volunteers to help improve SolidOS. Pull Requests (PRs) and edits are always welcome from code, to text, to style. We are looking for UX designers, technical writers, frontend developers, backend developers, DevOps. Don't let these titles intimidate you; they are just some examples. You can find your own place no matter the level of knowledge you are at.
To check possible tasks you can help with, the best is to visit us on a weekly team meeting or on the instant chat and say 'Hi'. We will try our best to pair you up with a buddy to help you to get started.
We keep track of stuff to do in Git issues of each repo. Here is the link to the SolidOS open issues. But make sure to visit the underlying repos for specific issues (see: SolidOS technical intro for links).
Writing tests as a way to understand the code is always a good idea. Tests, in each repo, should be found in the test folder. One can start from there or/and add tests there.
There is a process and code in place to help with SolidOS releases. However, we would like to get better and automatize as much as possible. We describe next each part.
SolidOS contains different repositories (mashlib, solid-logic, solid-ui, solid-panes, ...). Each repository contains a package.json with scripts. Most repos contain an npm run build which is used to build the project.
When you push or PR a change to a repo, usually a git CI is activated and runs every time. An example is the solid-panes workflow. This CI YML can contain instructions to test and build the repo on different Node versions. If upon push or PR, an instruction fails, one should take care to fix it.
In SolidOS, you will find a bash scripts under scripts which is related to releasing a new SolidOS version. The release script is also used to update dependencies in each repo.
Following best practices, we deploy the new version on the testserver as mentioned here.
Before you start, make sure you have access to all the GitHub repos and all the npm packages. Using Ubuntu or other Unix-like OS, ssh into the server as root.
tmux new
adduser --shell /bin/bash --home /home/build --ingroup sudo build
su - build
whoami
sudo whoamiThen:
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.37.0/install.sh | bash
export NVM_DIR="$([ -z "${XDG_CONFIG_HOME-}" ] && printf %s "${HOME}/.nvm" || printf %s "${XDG_CONFIG_HOME}/nvm")"
[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh" # This loads nvm
nvm install 16
nvm use 16
ssh-keygen -t ed25519 -C "michiel+build@unhosted.org"
git config --global user.name "Solid OS Build (Michiel)"
git config --global user.email "michiel+build@unhosted.org"
cat .ssh/id_ed25519.pub
npm loginLog in to npm with your npm account and add the SSH public key to your GitHub account. Then continue:
git clone https://github.com/solidos/solidos
cd solidos
npm run install-nvm
npm run releaseMore information can be also found over at the server, solidcommunity.net, repo.
SolidOS has quite some documentation around it that needs constant improvement. Places to start:
- for how SolidOS works visit the user guide and SolidOS project Pod;
- SolidOS FAQs;
- SolidOS developer guide.
We are open to suggestions to improve these resources from structure, translation, UI to content in general.
Solid-ui does the heavy lifting to all things UI for SolidOS. Currently, we use Storybook to help develop components independent of other panes. Make sure to visit the solid-ui readme for information on how to set it up and get started. There is a second option to run Solid-ui on its own. Read about it at Debugging solid-ui using Solid Pane Tester.
You can also find the current issues over at the solid-ui issues. And some more information over at the developer guide.
SolidOS needs a lot of improvements on UI, including UX and style-guides. Maybe you are the one who can help out?
Make sure you have the needed environment: nvm for SolidOS, npm, node. If you have problems with node versions on the Apple M1 chip, in the Troubleshooting SolidOS you can find a solution.
git clone https://github.com/solidos/solidos
cd solidos
npm run setup
Note: It might prompt you to install a dedicated node version, somthing like nvm install xxx # version missing mentioned in console log.
Note: In case of errors try to follow what the output messages (errors) suggest in the console to fix the problems. And write us up on SolidOS team chat.
Run the above lines in a terminal of your choice to setup your SolidOS project folder. By default, some dependent repos are also set up for you:
- rdflib.js: Javascript RDF library for browsers and Node.js
- solid-logic: core business logic of SolidOS
- pane-registry: an index to hold all loaded solid panes
- mashlib: a solid-compatible code library of application-level functionality for the world of Solid
- solid-panes: a set of core solid-compatible panes based on solid-ui
- solid-ui: User Interface widgets and utilities for Solid. Building blocks for solid-based apps
- node-solid-server: the server that allows you to test your changes
You can start your server and test out your code with:
npm start
If you get into problems check out SolidOS FAQs or ask us directly at SolidOS team chat.
Note: The NPM scripts are using bash scripts. These might not work if you're developing on a Windows machine. Let us know, over at SolidOS team chat if you want support for this.
Once you managed to get SolidOS running locally (npm start) you can see it over at https://localhost:8443/. If you encounter any problems make sure to check the Troubleshooting SolidOS page.
To work on localhost, first you need to register a local user, so hit register on https://localhost:8443/. After you have created your user, you can navigate to your new pod over at https://username.localhost:8443/.
Whenever you need to login again, remember to put https://localhost:8443/ in the Enter the URL of your identity provider: input field. Otherwise you will be logged in with a different provider and redirected out of the localhost environment.
As a newcomer, you do not have direct access to the repos, but you can still contribute through Pull Requests (PRs). First, navigate to the repo you want to work on, and create a fork. Make your changes on your fork, and then create a PR. We will be notified, and you will receive feedback on your changes. For more details on how to do this, visit the GitHub documentation, which explains it much better than we ever could.
If you do have direct access to the repos, it is usual to create a branch for your changes and then a PR. A PR helps you receive feedback and lets us know easily about any changes to the code. Read more about Pull Requests over at the GitHub documentation.
Make sure to read more about working with branches and missing repos over at the SolidOS developer guide.
Very likely you will want to make changes in the dependent packages/repos of SolidOS (mashlib, solid-logic, solid-ui, solid-panes...).
You have two choices:
The npm start script contains a lerna command: npx lerna bootstrap --force-local which makes sure that packages are bootstrapped/taken from your local machine even if versions don't match.
If you need to bootstrap any packages again (e.g. you've run npm install in any of the projects) and don't want to stop the server, you can do npx lerna bootstrap --force-local only. You do not need to stop the server and start it again (npm start).
Another option is to start SolidOS with the npm run watch script. This triggers the watch-script for mashlib, solid-ui, and solid-panes. If you want to run watch-script for rdflib or any of the panes, you'll have to open another terminal window, navigate to the respective project and start its watch-script doing npm run watch.
The output for the watch-script can be a bit difficult to interpret since all output for mashlib, solid-ui, and solid-panes are presented in the same window. You might also consider having each watch scripts running in a separate terminal window. The downside of using this approach is that at its worst, you'll have five separate watch-scripts running (in addition to the terminal window where you started the server) when working on a pane that needs to pick up a change in rdflib. If you find this unwieldy for your setup, or require too many resources, you should consider to work in the according dependent package.
Any changes you do in a project need to be committed to their original repos and eventually be pushed to NPM manually (this is the part of Lerna that we do not use for this project).
Some projects require you to build a package before you can see changes, so check the various package.json files to see which scripts are available. You can usually do npm run build, and some also support npm run watch which builds a new version each time you do a local change.
Be aware, the packages depend on one another. Here's a simplified view of the dependencies:
node-solid-server --> rdflib
node-solid-server --> mashlib --> rdflib
node-solid-server --> mashlib --> solid-panes --> rdflib
node-solid-server --> mashlib --> solid-panes --> solid-ui --> rdflib
node-solid-server --> mashlib --> solid-panes --> [pane project] --> solid-ui --> rdflib
This means that if you do a change in solid-panes and want to see the result on your local NSS, you need to make sure that mashlib compiles the changes as well. Similarly, if you do changes to solid-ui, and some pane relies on those changes, you need to make sure that the pane compiles those changes, that solid-panes compiles the changes from the pane, and finally that mashlib compiles the changes from solid-panes. This quickly becomes hard to track, so we've devised a couple of ways to mitigate this.
Read about in detail how each pane can be debugged over at the Solid developer guide.
Most of the modules in SolidOS have a test script which can be called with npm run test.
In some cases the tests run an ESLint command eslint 'src/**/*.ts' or a jest test or both.
Jest can also offer information related to test coverage by simply runnig npm run coverage.
You can find a repo's tests usually in a dedicated folder called test.
The SolidOS code stack build and release are described above.
The SolidOS code is available under the MIT License.
Don't hesitate to chat with us on gitter or report a bug.