HLSL custom bitpacking not working correctly
I'm a bit of a noob with Directx but i have been trying to get this custom bitpacking working all day. I'm trying to pack a float4 and another float into a uint. The float4 is a color and the float is a depth value. I want to use 6 bits each for the color, and the remaining 8 bits for depth. Precision is not important. I thought I understood what i was doing, but when unpacking, it just keeps returning all zeros. Is this even possible? The pixel format is R16G16B16A16_FLOAT.
Here is the code
uint PackColorAndDepthToUint(float4 Color, float Depth)
{
uint4 u = (int4) (Color * float4(255, 255, 255, 1.0f));
uint packedOutput = (u.a << 26) | (u.b << 20) | (u.g << 14) | (u.r << 8) | asuint(Depth * 255);
return packedOutput;
}
void UnpackColorAndDepthFromUint(uint packedInput, out float4 Color, out float Depth)
{
uint d = (packedInput & 255);
Depth = ((float) d / 255);
uint r = (((packedInput >> 8)) & 64);
uint g = (((packedInput >> 14)) & 64);
uint b = (((packedInput >> 20)) & 64);
uint a = (((packedInput >> 26)) & 64);
uint4 co = uint4(r, g, b, a);
Color = (((float4) co) / float4(255, 255, 255, 1.0f));
}
if anyone can point me in the right direction i would appreciate it!
directx directx-11 hlsl pixel-shader
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
add a comment |
I'm a bit of a noob with Directx but i have been trying to get this custom bitpacking working all day. I'm trying to pack a float4 and another float into a uint. The float4 is a color and the float is a depth value. I want to use 6 bits each for the color, and the remaining 8 bits for depth. Precision is not important. I thought I understood what i was doing, but when unpacking, it just keeps returning all zeros. Is this even possible? The pixel format is R16G16B16A16_FLOAT.
Here is the code
uint PackColorAndDepthToUint(float4 Color, float Depth)
{
uint4 u = (int4) (Color * float4(255, 255, 255, 1.0f));
uint packedOutput = (u.a << 26) | (u.b << 20) | (u.g << 14) | (u.r << 8) | asuint(Depth * 255);
return packedOutput;
}
void UnpackColorAndDepthFromUint(uint packedInput, out float4 Color, out float Depth)
{
uint d = (packedInput & 255);
Depth = ((float) d / 255);
uint r = (((packedInput >> 8)) & 64);
uint g = (((packedInput >> 14)) & 64);
uint b = (((packedInput >> 20)) & 64);
uint a = (((packedInput >> 26)) & 64);
uint4 co = uint4(r, g, b, a);
Color = (((float4) co) / float4(255, 255, 255, 1.0f));
}
if anyone can point me in the right direction i would appreciate it!
directx directx-11 hlsl pixel-shader
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
How did you check that you only get zero? When and where are you packing and unpacking? Where is the value stored in between? Two minor things: A multiplier of 1 for the alpha channel seems wrong (why not 255 as for the other channels?). Furthermore, you should mask the six bits of your color components when packing (so as to not influence the other components). Better also do it for the depth value.
– Nico Schertler
Nov 17 '18 at 17:44
add a comment |
I'm a bit of a noob with Directx but i have been trying to get this custom bitpacking working all day. I'm trying to pack a float4 and another float into a uint. The float4 is a color and the float is a depth value. I want to use 6 bits each for the color, and the remaining 8 bits for depth. Precision is not important. I thought I understood what i was doing, but when unpacking, it just keeps returning all zeros. Is this even possible? The pixel format is R16G16B16A16_FLOAT.
Here is the code
uint PackColorAndDepthToUint(float4 Color, float Depth)
{
uint4 u = (int4) (Color * float4(255, 255, 255, 1.0f));
uint packedOutput = (u.a << 26) | (u.b << 20) | (u.g << 14) | (u.r << 8) | asuint(Depth * 255);
return packedOutput;
}
void UnpackColorAndDepthFromUint(uint packedInput, out float4 Color, out float Depth)
{
uint d = (packedInput & 255);
Depth = ((float) d / 255);
uint r = (((packedInput >> 8)) & 64);
uint g = (((packedInput >> 14)) & 64);
uint b = (((packedInput >> 20)) & 64);
uint a = (((packedInput >> 26)) & 64);
uint4 co = uint4(r, g, b, a);
Color = (((float4) co) / float4(255, 255, 255, 1.0f));
}
if anyone can point me in the right direction i would appreciate it!
directx directx-11 hlsl pixel-shader
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
I'm a bit of a noob with Directx but i have been trying to get this custom bitpacking working all day. I'm trying to pack a float4 and another float into a uint. The float4 is a color and the float is a depth value. I want to use 6 bits each for the color, and the remaining 8 bits for depth. Precision is not important. I thought I understood what i was doing, but when unpacking, it just keeps returning all zeros. Is this even possible? The pixel format is R16G16B16A16_FLOAT.
Here is the code
uint PackColorAndDepthToUint(float4 Color, float Depth)
{
uint4 u = (int4) (Color * float4(255, 255, 255, 1.0f));
uint packedOutput = (u.a << 26) | (u.b << 20) | (u.g << 14) | (u.r << 8) | asuint(Depth * 255);
return packedOutput;
}
void UnpackColorAndDepthFromUint(uint packedInput, out float4 Color, out float Depth)
{
uint d = (packedInput & 255);
Depth = ((float) d / 255);
uint r = (((packedInput >> 8)) & 64);
uint g = (((packedInput >> 14)) & 64);
uint b = (((packedInput >> 20)) & 64);
uint a = (((packedInput >> 26)) & 64);
uint4 co = uint4(r, g, b, a);
Color = (((float4) co) / float4(255, 255, 255, 1.0f));
}
if anyone can point me in the right direction i would appreciate it!
directx directx-11 hlsl pixel-shader
directx directx-11 hlsl pixel-shader
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
asked Nov 16 '18 at 21:45
kostenickjkostenickj
61
61
How did you check that you only get zero? When and where are you packing and unpacking? Where is the value stored in between? Two minor things: A multiplier of 1 for the alpha channel seems wrong (why not 255 as for the other channels?). Furthermore, you should mask the six bits of your color components when packing (so as to not influence the other components). Better also do it for the depth value.
– Nico Schertler
Nov 17 '18 at 17:44
add a comment |
How did you check that you only get zero? When and where are you packing and unpacking? Where is the value stored in between? Two minor things: A multiplier of 1 for the alpha channel seems wrong (why not 255 as for the other channels?). Furthermore, you should mask the six bits of your color components when packing (so as to not influence the other components). Better also do it for the depth value.
– Nico Schertler
Nov 17 '18 at 17:44
How did you check that you only get zero? When and where are you packing and unpacking? Where is the value stored in between? Two minor things: A multiplier of 1 for the alpha channel seems wrong (why not 255 as for the other channels?). Furthermore, you should mask the six bits of your color components when packing (so as to not influence the other components). Better also do it for the depth value.
– Nico Schertler
Nov 17 '18 at 17:44
How did you check that you only get zero? When and where are you packing and unpacking? Where is the value stored in between? Two minor things: A multiplier of 1 for the alpha channel seems wrong (why not 255 as for the other channels?). Furthermore, you should mask the six bits of your color components when packing (so as to not influence the other components). Better also do it for the depth value.
– Nico Schertler
Nov 17 '18 at 17:44
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53345852%2fhlsl-custom-bitpacking-not-working-correctly%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53345852%2fhlsl-custom-bitpacking-not-working-correctly%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
How did you check that you only get zero? When and where are you packing and unpacking? Where is the value stored in between? Two minor things: A multiplier of 1 for the alpha channel seems wrong (why not 255 as for the other channels?). Furthermore, you should mask the six bits of your color components when packing (so as to not influence the other components). Better also do it for the depth value.
– Nico Schertler
Nov 17 '18 at 17:44