There are 2 different and distinct approaches to browse the HDFS datalake: A. Through the WebHDFS API B. Through the native Hadoop CLI
WebHDFS offers REST API for users to access data on the HDFS filesystem using the HTTP protocol. The activation of this feature is configured on the cluster side through the following directive in the hdfs-site.xml file:
dfs.webhdfs.enabled: true|false Enable WebHDFS (REST API) in Namenodes and Datanodes.
The API allows to perform all possible actions on the HDFS filesystem (view, create, modify, etc.).
By default, if Kerberos authentication is not enabled, no credential is needed to request these services: only user identification is needed using the user.name parameter. WebHDFS API are exposed on the following services:
DataNode HDFS DataNode WebUI on port 50075
Third-party HttpFS module on port 14000
Another possible method to list the content is to call the /listPaths/ URI on a NameNode WebUI on port 50070 which returns an XML file.
共 4 兑换
暂无临时解决方案
暂无官方解决方案
暂无防护方案
※本站提供的任何内容、代码与服务仅供学习，请勿用于非法用途，否则后果自负
续费请拨打客服热线，感谢您一直支持 Seebug!
京公网安备 11010502034610号
暂无评论