Skip to content

Commit 27d7532

Browse files
committed
Link to arXiv version
1 parent b1aa6ca commit 27d7532

File tree

2 files changed

+13
-5
lines changed

2 files changed

+13
-5
lines changed

README.md

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,14 @@
11

22
# PrivateKube
33

4-
PrivateKube is an extension to the popular Kubernetes datacenter orchestrator that adds privacy as a new type of resource to be managed alongside other traditional compute resources, such as CPU, GPU, and memory. A description of the project can be found on our [webpage](https://systems.cs.columbia.edu/PrivateKube/) and in our OSDI'21 paper, titled [Privacy Budget Scheduling](https://www.usenix.org/conference/osdi21/presentation/luo) (PDF locally available [here](https://columbia.github.io/PrivateKube/papers/osdi2021privatekube.pdf)).
4+
PrivateKube is an extension to the popular Kubernetes datacenter orchestrator that adds privacy as a new type of resource to be managed alongside other traditional compute resources, such as CPU, GPU, and memory. A description of the project can be found on our [webpage](https://systems.cs.columbia.edu/PrivateKube/) and in our OSDI'21 paper, titled [Privacy Budget Scheduling](https://www.usenix.org/conference/osdi21/presentation/luo) (PDF locally available [here](https://columbia.github.io/PrivateKube/papers/osdi2021privatekube.pdf) and extended version available on [arXiv](https://arxiv.org/abs/2106.15335).
55

66

77
## Repo structure
88

99
This repository contains the artifact release for the OSDI paper:
1010
- [system](system/): The PrivateKube system, which implements the privacy resource and a new scheduling algorithm for it, called *Dominant Privacy Fairness (DPF)*.
11-
- [privatekube](privatekube/): A python client for interaction with the PrivateKube system and performing macrobenchmark evaluation.
11+
- [privatekube](privatekube/): A Python client for interaction with the PrivateKube system and performing macrobenchmark evaluation.
1212
- [simulator](simulator/): A simulator for microbenchmarking privacy scheduling algorithms in tightly controlled settings.
1313
- [examples](examples/): Usage examples for various components, please refer its [README](./examples/README.md) for details.
1414
- [evaluation](evaluation/): Scripts to reproduce the macrobenchmark and microbenchmark evaluation results from our paper.
@@ -27,7 +27,7 @@ This repository contains the artifact release for the OSDI paper:
2727
- [1.4. Example usage in a DP ML pipeline](#14-example-usage-in-a-dp-ml-pipeline)
2828
- [2. Getting started with the simulator](#2-getting-started-with-the-simulator)
2929
- [2.1 Setup](#21-setup)
30-
- [Setup python environment](#setup-python-environment)
30+
- [Setup a Python environment](#setup-a-python-environment)
3131
- [Installation from source](#installation-from-source)
3232
- [2.2 Examples](#22-examples)
3333
- [The minimal simulation example](#the-minimal-simulation-example)
@@ -63,6 +63,7 @@ mkdir ~/.kube
6363
6464
sudo chown -f -R $USER ~/.kube
6565
```
66+
(You can learn more about how to use Microk8s without sudo [here](https://github.com/ubuntu/microk8s/blob/feature/dev-docs/docs/access-without-sudo.md))
6667

6768
You can now start and stop your cluster with:
6869
```bash
@@ -247,8 +248,8 @@ This simulator is used for prototyping and microbenchmark evaluation of privacy
247248

248249
### 2.1 Setup
249250

250-
#### Setup python environment
251-
Install conda, create and activate an isolated python environment "ae".
251+
#### Setup a Python environment
252+
Install Conda, create and activate an isolated Python environment "ae".
252253
```bash
253254
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda.sh
254255
bash ~/miniconda.sh -b -p $HOME/miniconda

evaluation/macrobenchmark/README.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,21 @@
11

22
# Macrobenchmark
33

4+
5+
## Requirements
6+
47
The commands in this section have to be run from the `macrobenchmark` directory. You can jump there with:
58

69
```bash
710
cd evaluation/macrobenchmark
811
```
912

13+
You should have the `privatekube` Python package installed, as described in the [main README](https://github.com/columbia/PrivateKube).
14+
1015
Please note that the steps below can take several days to run, depending on your hardware. If you want to examine the experimental data without running the preprocessing or the training yourself, you can download some artifacts from this [public bucket](https://storage.googleapis.com/privatekube-public-artifacts).
1116

17+
Training will be faster with a Nvidia GPU, but you can also use your CPU by specifying `--device=cpu` in the script arguments.
18+
1219
## Download and preprocess the dataset
1320

1421
To download a preprocessed and truncated (140Mb instead of 7Gb) version of the dataset, run the following:

0 commit comments

Comments
 (0)