Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
/.gradle
/.idea
/.vscode
/build
/bin
/data/*.csv
/result.txt
3 changes: 0 additions & 3 deletions 0.csv

This file was deleted.

3 changes: 0 additions & 3 deletions 1.csv

This file was deleted.

3 changes: 0 additions & 3 deletions 2.csv

This file was deleted.

3 changes: 0 additions & 3 deletions 3.csv

This file was deleted.

3 changes: 0 additions & 3 deletions 4.csv

This file was deleted.

3 changes: 0 additions & 3 deletions 5.csv

This file was deleted.

3 changes: 0 additions & 3 deletions 6.csv

This file was deleted.

3 changes: 0 additions & 3 deletions 7.csv

This file was deleted.

1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
[![Review Assignment Due Date](https://classroom.github.com/assets/deadline-readme-button-22041afd0340ce965d47ae6ef1cefeee28c7c493a6346c4f15d667ab976d596c.svg)](https://classroom.github.com/a/-hH64FG6)
## Лабораторная работа: Реализация MapReduce для анализа данных о продажах с ипользованием HADOOP!!!
# Цель работы

Expand Down
32 changes: 32 additions & 0 deletions build.gradle.kts
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
plugins {
java
}

group = "org.itmo"
version = "0.0.1"

java {
toolchain {
languageVersion = JavaLanguageVersion.of(8)
}
}


repositories {
mavenCentral()
}

dependencies {
implementation("org.apache.hadoop:hadoop-common:3.2.1")
implementation("org.apache.hadoop:hadoop-client:3.2.1")

compileOnly("org.projectlombok:lombok:1.18.36")
annotationProcessor("org.projectlombok:lombok:1.18.36")

testCompileOnly("org.projectlombok:lombok:1.18.36")
testAnnotationProcessor("org.projectlombok:lombok:1.18.36")
}

tasks.withType<Test> {
useJUnitPlatform()
}
27 changes: 27 additions & 0 deletions compose.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
volumes:
hadoop_namenode:
hadoop_datanode:

services:
namenode:
image: bde2020/hadoop-namenode:2.0.0-hadoop3.2.1-java8
container_name: namenode
restart: unless-stopped
ports:
- "9870:9870"
- "9000:9000"
volumes:
- hadoop_namenode:/hadoop/dfs/name
environment:
CLUSTER_NAME: "local-cluster"
CORE_CONF_fs_defaultFS: "hdfs://namenode:9000"
HDFS_CONF_dfs_replication: "1"

datanode:
image: bde2020/hadoop-datanode:2.0.0-hadoop3.2.1-java8
container_name: datanode
restart: unless-stopped
volumes:
- hadoop_datanode:/hadoop/dfs/data
environment:
CORE_CONF_fs_defaultFS: "hdfs://namenode:9000"
Empty file added data/.gitkeep
Empty file.
Binary file added gradle/wrapper/gradle-wrapper.jar
Binary file not shown.
7 changes: 7 additions & 0 deletions gradle/wrapper/gradle-wrapper.properties
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
distributionBase=GRADLE_USER_HOME
distributionPath=wrapper/dists
distributionUrl=https\://services.gradle.org/distributions/gradle-8.5-bin.zip
networkTimeout=10000
validateDistributionUrl=true
zipStoreBase=GRADLE_USER_HOME
zipStorePath=wrapper/dists
249 changes: 249 additions & 0 deletions gradlew

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading