-
Notifications
You must be signed in to change notification settings - Fork 0
/
packages.html
164 lines (118 loc) · 10.5 KB
/
packages.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
<!DOCTYPE html>
<html lang="en">
<head>
<meta http-equiv="content-type" content="text/html; charset=ISO-8859-1" />
<meta name="author" content="wrathematics" />
<meta name="robots" content="all" />
<meta name="MSSmartTagsPreventParsing" content="true" />
<meta name="description" content="pbdR - Programming with Big Data in R" />
<meta name="keywords" content="pbdR,R,Big Data,pbdMPI,pbdSLAP,pbdBASE,pbdDMAT,pbdDEMO,pbdNCDF4,pbdPROF,Statistical Computing,Parallel Computing" />
<meta charset='utf-8' />
<meta http-equiv="X-UA-Compatible" content="chrome=1" />
<meta name="description" content="Rbigdata.github.io : " />
<title>pbdR - Programming with Big Data in R</title>
<!-- google botnet -->
<script src="ui/js/botnet.js"></script>
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="stylesheet" href="ui/css/bootstrap.min.css" media="screen">
<link rel="stylesheet" href="ui/css/custom.css" media="screen">
</head>
<body>
<nav class="navbar navbar-default navbar-fixed-top">
<div class="container">
<div class="navbar-header">
<button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#navbar" aria-expanded="false" aria-controls="navbar">
<span class="sr-only">Toggle navigation</span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
<a href="index.html" class="navbar-brand">
<font color="#38761D">p</font><font color="#990000">b</font><font color="#BF9000">d</font><font color="#8698C0">R</font>
</a>
</div>
<div id="navbar" class="collapse navbar-collapse">
<ul class="nav navbar-nav">
<li><a href="index.html">About</a></li>
<li class="active"><a href="packages.html">Packages</a></li>
<li><a href="publications.html">Publications</a></li>
</ul>
</div><!--/.nav-collapse -->
</div>
</nav>
<xmp theme="" style="display:none;">
# Releases
Stable pbdR releases can be found [here](releases).
We maintain development versions of all of our packages on our
[GitHub project page](https://github.com/RBigData). We also try, whenever
possible, to maintain releases on the [CRAN](http://cran.r-project.org/).
<!--
Additionally, you can find current binaries of our packages for the
Windows operating system at our sister site,
[HPSC](http://thirteen-01.stat.iastate.edu/snoweye/pbdr/?item=download).
-->
# pbdR Packages
* [Application](#application)
* [Communication](#communication)
* [Computation](#computation)
* [Developers](#developers)
* [I/O](#io)
* [Profiling](#profiling)
## <a id="application"></a>Application <small>Specifically purposed packages that utilize pbdR.</small>
| Package | Description | Download | Documentation |
|---------|------------- | :------: | :-----------: |
| pbdML | Machine learning algorithms, using pbdDMAT. | [ghbutton](http://github.com/RBigData/pbdML) | [htmlbutton](http://pbdr.org/documentation/pbdML/00Index.html)
| cubfits | Codon Usage Bias Fits, using pbdMPI. Estimating mutation and selection coefficients on synonymous codon bias usage based on models of ribosome overhead cost (ROC). Multinomial logistic regression and Markov Chain Monte Carlo are used to estimate and predict protein production rates with/without the presence of expressions and measurement errors. | [ghbutton](http://github.com/snoweye/cubfits) <br> [cranbutton](http://cran.r-project.org/package=cubfits) | [htmlbutton](http://pbdr.org/documentation/cubfits/00Index.html)
| pmclust | Tools for parallel model-based clustering. These include k-means and Gaussian mixture modeling, and can be applied to ad hoc distributed matrices as well as pbdDMAT conformable ones. | [ghbutton](http://github.com/RBigData/pmclust) <br> [cranbutton](http://cran.r-project.org/package=pmclust) | [htmlbutton](http://pbdr.org/documentation/pmclust/00Index.html)
| pbdDEMO | A collection of pbdR package demonstrations and examples. Also included is a lengthy, textbook-style vignette to help quickly move R programmers from their laptops to distributed platforms. | [ghbutton](http://github.com/RBigData/pbdDEMO) | [htmlbutton](http://pbdr.org/documentation/pbdDEMO/00Index.html)
## <a id="communication"></a>Communication <small>Tools for handling multi-machine communication.</small>
| Package | Description | Download | Documentation |
|---------|------------- | :------: | :-----------: |
| pbdRPC | Remote Procedure Call. A very light implementation yet secure for remote procedure calls with unified interface via ssh (OpenSSH) or plink/plink.exe (PuTTY). | [ghbutton](http://github.com/RBigData/pbdRPC) | [htmlbutton](http://pbdr.org/documentation/pbdRPC/00Index.html)
| remoter | A collection of utilities for performing R computations on a remote resource. With the package, one can use their local R session (and gui of preference, e.g. RStudio) to connect to a remote server instance, and without modifying their code, have it executed on the remote instance. The package is a version of pbdCS with the MPI innards stripped out. | [ghbutton](http://github.com/RBigData/remoter) <br> [cranbutton](http://cran.r-project.org/package=remoter) | [htmlbutton](http://pbdr.org/documentation/remoter/00Index.html)
| pbdCS | A client/server framework for pbdR. With this package, one can move from batch SPMD programming to interactivity at thousands of cores. | [ghbutton](http://github.com/RBigData/pbdCS)
| pbdZMQ | A set of bindings for the well-known ZeroMQ communication library. pbdZMQ greatly eases the burdens of network programming for R users. Additionally, the package serves as a distribution of ZeroMQ, making installation trivial. It serves as the foundation of the remoter and pbdCS packages. | [ghbutton](http://github.com/RBigData/pbdZMQ) <br> [cranbutton](http://cran.r-project.org/package=pbdZMQ) | [htmlbutton](http://pbdr.org/documentation/pbdZMQ/00Index.html)
## <a id="computation"></a>Computation <small>Packages frameworks for building other scalable tools.</small>
| Package | Description | Download | Documentation |
|---------|------------- | :------: | :-----------: |
| pbdDMAT | Distributed matrix classes and methods. The package includes numerous methods for manipulating and reshaping distributed matrices, as well as linear algebra and statistics routines. Through extensive use of R's S4 methods, these functions have identical syntax to serial R. | [ghbutton](http://github.com/RBigData/pbdDMAT) | [htmlbutton](http://pbdr.org/documentation/pbdDMAT/00Index.html)
| pbdMPI | A high-level interface to MPI. The package handles linking issues, as well as offers a very simple R interface for MPI programming. | [ghbutton](http://github.com/RBigData/pbdMPI) <br> [cranbutton](http://cran.r-project.org/package=pbdMPI) | [htmlbutton](http://pbdr.org/documentation/pbdMPI/00Index.html)
## <a id="developers"></a>Developers <small>Tools for developers.</small>
| Package | Description | Download | Documentation |
|---------|------------- | :------: | :-----------: |
| pbdTEST | A testing framework for pbdR. | [ghbutton](http://github.com/RBigData/pbdTEST) |
| pbdBASE | Base utilities for distributed matrices. For advanced programmers only. | [ghbutton](http://github.com/RBigData/pbdBASE) | [htmlbutton](http://pbdr.org/documentation/pbdBASE/00Index.html)
| pbdSLAP | The Scalable Linear Algebra Package. A distribution of ScaLAPACK, this package greatly simplifies package build and linking issues for distribute matrix programming. | [ghbutton](http://github.com/RBigData/pbdSLAP) | [htmlbutton](http://pbdr.org/documentation/pbdSLAP/00Index.html)
## <a id="io"></a>I/O <small>Packages for large, scalable I/O.</small>
| Package | Description | Download | Documentation |
|---------|------------- | :------: | :-----------: |
| pbdNCDF4 | An R package interface to NetCDF version 4. The package adds collective parallel read and write capability to the R package ncdf4 version 1.8. | [ghbutton](http://github.com/RBigData/pbdNCDF4) | [htmlbutton](http://pbdr.org/documentation/pbdNCDF4/00Index.html)
## <a id="profiling"></a>Profiling <small>Performance analysis packages.</small>
| Package | Description | Download | Documentation |
|---------|------------- | :------: | :-----------: |
| hpcvis | Profiler visualizations. The package offers numerous plotters for data generated by pbdPROF and pbdPAPI. The package is kept separate so as not to include the graphics dependency chain on pbdPAPI and pbdPROF, as these dependencies may not be easily installed on supercomputers. | [ghbutton](http://github.com/RBigData/hpcvis) |
| pbdPROF | MPI profiling tools. The package offers utilities for linking with MPI-using R packages (pbdMPI and Rmpi), as well as tools for parsing profiler output files. fpmpi and mpiP are supported. | [ghbutton](http://github.com/RBigData/pbdPROF) | [htmlbutton](http://pbdr.org/documentation/pbdPROF/00Index.html)
| pbdPAPI | Bindings for PAPI. The package offers utilities for measuring and collecting performance counter data, such as number of floating point operations or cache misses. Linux (or FreeBSD with a custom kernel) only. | [ghbutton](http://github.com/RBigData/pbdPAPI) |
# <a id="installation">Installation Instructions</a>
A combined release of current GitHub and CRAN components of the pbdR
project along with an installer became available on March 5, 2018, as
[pbdR 1.0](https://pbdr.org/releases/). This and subsequent versions as
a single gzipped tar file are available
[here](https://pbdr.org/releases/).
There are two sets of instructions: one for those who wish to use Docker, and
one for those who do not. Under most circumstances, using the Docker builds is
much easier. This is a good fit for anyone wishing to use pbdR:
* On a desktop/laptop (caveat: OS version has to be reasonably new)
* In the cloud.
* On a cluster running Singularity.
For all other cases, installing the "native" versions will be necessary.
| Docker | Native |
|--------|--------|
| [pdfbutton](https://github.com/RBigData/installation-instructions/raw/master/build/docker.pdf) [htmlbutton](https://rawgit.com/wrathematics/installation-instructions/master/build/docker.html) | [pdfbutton](https://github.com/RBigData/installation-instructions/raw/master/build/native.pdf) [htmlbutton](https://rawgit.com/wrathematics/installation-instructions/master/build/native.html) |
</xmp>
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.3/jquery.min.js"></script>
<script src="http://netdna.bootstrapcdn.com/bootstrap/3.1.1/js/bootstrap.min.js"></script>
<script src="./ui/strapdown/strapdown.js"></script>
<script src="./ui/js/buttons.js"></script>
</body>
</html>