Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increased maven memory for build project #143

Open
zizu1985 opened this issue May 19, 2021 · 1 comment
Open

Increased maven memory for build project #143

zizu1985 opened this issue May 19, 2021 · 1 comment

Comments

@zizu1985
Copy link

Hi,

Problem appeared with chapter 9 data.
I had to use export MAVEN_OPTS="-Xmx8192m -XX:MaxPermSize=256m" to be able to build entire solution.

With lower heap size I've ended with below error
I wonder if it makes sens to add information about memory requirement for build in some README.

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Advanced Analytics with Spark 2.0.0 ................ SUCCESS [ 2.847 s]
[INFO] Introduction to Data Analysis with Scala and Spark 2.0.0 SUCCESS [ 6.911 s]
[INFO] Recommender Engines with Audioscrobbler data 2.0.0 . SUCCESS [ 0.210 s]
[INFO] Covtype with Random Decision Forests 2.0.0 ......... SUCCESS [ 0.194 s]
[INFO] Anomaly Detection with K-means 2.0.0 ............... SUCCESS [ 0.229 s]
[INFO] Wikipedia Latent Semantic Analysis 2.0.0 ........... SUCCESS [ 20.339 s]
[INFO] Network Analysis with GraphX 2.0.0 ................. SUCCESS [ 2.014 s]
[INFO] Temporal and Geospatial Analysis 2.0.0 ............. SUCCESS [ 0.361 s]
[INFO] Value at Risk through Monte Carlo Simulation 2.0.0 . FAILURE [06:44 min]
[INFO] Genomics Analysis with ADAM 2.0.0 .................. SKIPPED
[INFO] Simple Spark Project 0.1.0 ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:20 min
[INFO] Finished at: 2021-05-19T06:25:27-07:00
[INFO] ------------------------------------------------------------------------
[ERROR] Java heap space -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError

@srowen
Copy link
Collaborator

srowen commented May 19, 2021

Are you just trying to build? I don't think it should take that much memory but the default may be too low, sure. Is there any way to set that in the build itself rather than an env variable?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants