In which scenarios we do not allocate blocks to files?
The HDFS Quota Guide says the following for Space Quota. In which scenarios we do not allocate blocks to files?
A quota of zero still permits files to be created, but no blocks can
be added to the files.
hadoop hdfs namenode hdfs-quotas
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
add a comment |
The HDFS Quota Guide says the following for Space Quota. In which scenarios we do not allocate blocks to files?
A quota of zero still permits files to be created, but no blocks can
be added to the files.
hadoop hdfs namenode hdfs-quotas
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
1
Guessing, buthdfs dfs -touchzonly affects the Namenode. Doesn't allocate blocks
– cricket_007
Nov 7 '18 at 15:49
add a comment |
The HDFS Quota Guide says the following for Space Quota. In which scenarios we do not allocate blocks to files?
A quota of zero still permits files to be created, but no blocks can
be added to the files.
hadoop hdfs namenode hdfs-quotas
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
The HDFS Quota Guide says the following for Space Quota. In which scenarios we do not allocate blocks to files?
A quota of zero still permits files to be created, but no blocks can
be added to the files.
hadoop hdfs namenode hdfs-quotas
hadoop hdfs namenode hdfs-quotas
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
asked Nov 6 '18 at 19:50
Aravind R. Yarram
60.7k34186268
60.7k34186268
1
Guessing, buthdfs dfs -touchzonly affects the Namenode. Doesn't allocate blocks
– cricket_007
Nov 7 '18 at 15:49
add a comment |
1
Guessing, buthdfs dfs -touchzonly affects the Namenode. Doesn't allocate blocks
– cricket_007
Nov 7 '18 at 15:49
1
1
Guessing, but
hdfs dfs -touchz only affects the Namenode. Doesn't allocate blocks– cricket_007
Nov 7 '18 at 15:49
Guessing, but
hdfs dfs -touchz only affects the Namenode. Doesn't allocate blocks– cricket_007
Nov 7 '18 at 15:49
add a comment |
1 Answer
1
active
oldest
votes
A file in HDFS is analogous to an INode in more typical file systems. It may or may not contain data, and blocks will only be created if data is added to the file. For example, in the following snippet, no blocks are created because no data is added to the file:
FileSystem fs = ...
Path p = ...
fs.create(p).close();
Whereas in the following, a block is created:
FileSystem fs = ...
Path p = ...
try (FSDataOutputStream out = fs.create(p)) {
out.write(42);
}
answered Nov 12 '18 at 18:43
krog
258210
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53179012%2fin-which-scenarios-we-do-not-allocate-blocks-to-files%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
A file in HDFS is analogous to an INode in more typical file systems. It may or may not contain data, and blocks will only be created if data is added to the file. For example, in the following snippet, no blocks are created because no data is added to the file:
FileSystem fs = ...
Path p = ...
fs.create(p).close();
Whereas in the following, a block is created:
FileSystem fs = ...
Path p = ...
try (FSDataOutputStream out = fs.create(p)) {
out.write(42);
}
answered Nov 12 '18 at 18:43
krog
258210
add a comment |
A file in HDFS is analogous to an INode in more typical file systems. It may or may not contain data, and blocks will only be created if data is added to the file. For example, in the following snippet, no blocks are created because no data is added to the file:
FileSystem fs = ...
Path p = ...
fs.create(p).close();
Whereas in the following, a block is created:
FileSystem fs = ...
Path p = ...
try (FSDataOutputStream out = fs.create(p)) {
out.write(42);
}
answered Nov 12 '18 at 18:43
krog
258210
add a comment |
A file in HDFS is analogous to an INode in more typical file systems. It may or may not contain data, and blocks will only be created if data is added to the file. For example, in the following snippet, no blocks are created because no data is added to the file:
FileSystem fs = ...
Path p = ...
fs.create(p).close();
Whereas in the following, a block is created:
FileSystem fs = ...
Path p = ...
try (FSDataOutputStream out = fs.create(p)) {
out.write(42);
}
answered Nov 12 '18 at 18:43
krog
258210
A file in HDFS is analogous to an INode in more typical file systems. It may or may not contain data, and blocks will only be created if data is added to the file. For example, in the following snippet, no blocks are created because no data is added to the file:
FileSystem fs = ...
Path p = ...
fs.create(p).close();
Whereas in the following, a block is created:
FileSystem fs = ...
Path p = ...
try (FSDataOutputStream out = fs.create(p)) {
out.write(42);
}
answered Nov 12 '18 at 18:43
krog
258210
edited Nov 12 '18 at 21:42
answered Nov 12 '18 at 18:43
krog
258210
answered Nov 12 '18 at 18:43
krog
258210
answered Nov 12 '18 at 18:43
krog
258210
258210
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53179012%2fin-which-scenarios-we-do-not-allocate-blocks-to-files%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
Guessing, but
hdfs dfs -touchzonly affects the Namenode. Doesn't allocate blocks– cricket_007
Nov 7 '18 at 15:49