Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] Update Apache Ozone support in Hue docs section #3410

Merged
merged 2 commits into from
Jul 24, 2023
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -959,9 +959,37 @@ Verify that core-site.xml has the following configuration:

If the configuration is not present, add it to /etc/hadoop/conf/core-site.xml and restart Hadoop.

### Apache Ozone

Hue can read and write files on the Ozone filesystem, similar to HDFS. Add the following settings under `[desktop]`, and within the `[[ozone]]` section:

[[[default]]]
fs_defaultfs=ofs://[***SERVICE-ID***]
webhdfs_url=http://[***OZONE-HTTPFS-HOST***]:[***OZONE-HTTPFS-PORT***]/webhdfs/v1
ssl_cert_ca_verify=true
security_enabled=true

Where,
- **fs_defaultfs:** Ozone service ID (HA mode) or URL for Ozone Manager (non-HA mode).
- **webhdfs_url:** URL of HttpFS endpoint for the running Ozone service (`https` for secure service else `http`).

Configure Hue as a proxy user for all other users and groups, meaning it may submit a request on behalf of any other user:

HttpFS: Verify or add the following configuration in Ozone service's `httpfs-site.xml`:

<!-- Hue HttpFS proxy user setting -->
<property>
<name>httpfs.proxyuser.hue.hosts</name>
<value>*</value>
</property>
<property>
<name>httpfs.proxyuser.hue.groups</name>
<value>*</value>
</property>

### S3

Hue's filebrowser can now allow users to explore, manage, and upload data in an S3 account, in addition to HDFS.
Hue's filebrowser can now allow users to explore, manage, and upload data in an S3 account, in addition to HDFS and Ozone.

Read more about it in the [S3 User Documentation](/user/browsing#s3).

Expand Down Expand Up @@ -991,15 +1019,12 @@ Alternatively (but not recommended for production or secure environments), you c

The region should be set to the AWS region corresponding to the S3 account. By default, this region will be set to 'us-east-1'.

**Using Ozone**
Apache Ozone should work out of the box.

**Using Ceph**
New end points have been added in [HUE-5420](https://issues.cloudera.org/browse/HUE-5420)

### Azure File Systems

Hue's file browser can now allow users to explore, manage, and upload data in an ADLS v1 or ADLS v2 (ABFS), in addition to HDFS and S3.
Hue's file browser can now allow users to explore, manage, and upload data in an ADLS v1 or ADLS v2 (ABFS), in addition to HDFS, Ozone and S3.

In order to add an Azure account to Hue, you'll need to configure Hue with valid Azure credentials, including the client ID, client secret and tenant ID.
These keys can securely stored in a script that outputs the actual access key and secret key to stdout to be read by Hue (this is similar to how Hue reads password scripts). In order to use script files, add the following section to your hue.ini configuration file:
Expand Down Expand Up @@ -1034,10 +1059,6 @@ The json credentials of a service account can be stored for development in plain
[[[default]]]
json_credentials='{ "type": "service_account", "project_id": .... }'

### Apache Ozone

The API is the same as [S3](#s3).

### HBase

Specify the comma-separated list of HBase Thrift servers for clusters in the format of "(name|host:port)":
Expand Down
Loading