How to optimize AR markers for large open spaces?












1















The setup is this: we're trying to show an AR object in an open space standing next to a marker. The purpose of the marker isn't to position the object 100% on/at the marker but to give a "best guess" that the person is looking in the right direction.



Imagine the viewer looking at a scene where there's a traffic sign, and they are looking at it from e.g. 15 yards away, and while the person is looking at the traffic sign, we want to draw an AR character approximately next to the sign. Just instead of the traffic sign (but approximately of the same dimensions) we can use an arbitrary image.



While viewing this scene through the AR camera from this distance, any "natural looking" marker is rather small.



Is there a way / technique / best practice of picking / adjusting / optimising a marker so that it's detected while occupying a relatively small pixel area from the camera?



And an additional question: Naively, without much knowledge in this field, I'd expect that the best markers would be a high contrast text, or a non-symmetrical arrangement of geometrical shapes (so, literally like traffic signs), but apparently more realistic images with shades in them are preferred? Why is that so?










share|improve this question



























    1















    The setup is this: we're trying to show an AR object in an open space standing next to a marker. The purpose of the marker isn't to position the object 100% on/at the marker but to give a "best guess" that the person is looking in the right direction.



    Imagine the viewer looking at a scene where there's a traffic sign, and they are looking at it from e.g. 15 yards away, and while the person is looking at the traffic sign, we want to draw an AR character approximately next to the sign. Just instead of the traffic sign (but approximately of the same dimensions) we can use an arbitrary image.



    While viewing this scene through the AR camera from this distance, any "natural looking" marker is rather small.



    Is there a way / technique / best practice of picking / adjusting / optimising a marker so that it's detected while occupying a relatively small pixel area from the camera?



    And an additional question: Naively, without much knowledge in this field, I'd expect that the best markers would be a high contrast text, or a non-symmetrical arrangement of geometrical shapes (so, literally like traffic signs), but apparently more realistic images with shades in them are preferred? Why is that so?










    share|improve this question

























      1












      1








      1








      The setup is this: we're trying to show an AR object in an open space standing next to a marker. The purpose of the marker isn't to position the object 100% on/at the marker but to give a "best guess" that the person is looking in the right direction.



      Imagine the viewer looking at a scene where there's a traffic sign, and they are looking at it from e.g. 15 yards away, and while the person is looking at the traffic sign, we want to draw an AR character approximately next to the sign. Just instead of the traffic sign (but approximately of the same dimensions) we can use an arbitrary image.



      While viewing this scene through the AR camera from this distance, any "natural looking" marker is rather small.



      Is there a way / technique / best practice of picking / adjusting / optimising a marker so that it's detected while occupying a relatively small pixel area from the camera?



      And an additional question: Naively, without much knowledge in this field, I'd expect that the best markers would be a high contrast text, or a non-symmetrical arrangement of geometrical shapes (so, literally like traffic signs), but apparently more realistic images with shades in them are preferred? Why is that so?










      share|improve this question














      The setup is this: we're trying to show an AR object in an open space standing next to a marker. The purpose of the marker isn't to position the object 100% on/at the marker but to give a "best guess" that the person is looking in the right direction.



      Imagine the viewer looking at a scene where there's a traffic sign, and they are looking at it from e.g. 15 yards away, and while the person is looking at the traffic sign, we want to draw an AR character approximately next to the sign. Just instead of the traffic sign (but approximately of the same dimensions) we can use an arbitrary image.



      While viewing this scene through the AR camera from this distance, any "natural looking" marker is rather small.



      Is there a way / technique / best practice of picking / adjusting / optimising a marker so that it's detected while occupying a relatively small pixel area from the camera?



      And an additional question: Naively, without much knowledge in this field, I'd expect that the best markers would be a high contrast text, or a non-symmetrical arrangement of geometrical shapes (so, literally like traffic signs), but apparently more realistic images with shades in them are preferred? Why is that so?







      arcore android-augmented-reality






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 19 '18 at 21:04









      Ivan VorasIvan Voras

      1,236813




      1,236813
























          1 Answer
          1






          active

          oldest

          votes


















          1














          Answer to your first question is really not easy. Because it is not just detecting a marker or an augmented image but it is tracking these images. So you can gather position and rotation information of the marker as well. Any change in the rotation and the position of the marker can be detected. This is essentially done via extracting feature points and tracking position of these points relative to different pose of the device. My advice to you could be trying HelloAR example and trying to visualize feature points on your marker from 15 yard. This will give you the rough idea why you can not optimize such distances. ARCore is using visual odometry so these feature points play a vital role in tracking. This is probably the reason to your additional question because we do not only need to detect the markers but we also have to track them. Therefore, more optimal points means more feature points and this makes tracking easier. One bad work around might be if you know the distance of the traffic sign and start your AR app aligned with the sign you can create arbitrary anchors at any points using `Session.createAnchor. However, as i said this will not be a good solution. I can try to help if you provide more information about the use case maybe somehow you can make arbitrary anchors work. Good luck!






          share|improve this answer























            Your Answer






            StackExchange.ifUsing("editor", function () {
            StackExchange.using("externalEditor", function () {
            StackExchange.using("snippets", function () {
            StackExchange.snippets.init();
            });
            });
            }, "code-snippets");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "1"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382596%2fhow-to-optimize-ar-markers-for-large-open-spaces%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            1














            Answer to your first question is really not easy. Because it is not just detecting a marker or an augmented image but it is tracking these images. So you can gather position and rotation information of the marker as well. Any change in the rotation and the position of the marker can be detected. This is essentially done via extracting feature points and tracking position of these points relative to different pose of the device. My advice to you could be trying HelloAR example and trying to visualize feature points on your marker from 15 yard. This will give you the rough idea why you can not optimize such distances. ARCore is using visual odometry so these feature points play a vital role in tracking. This is probably the reason to your additional question because we do not only need to detect the markers but we also have to track them. Therefore, more optimal points means more feature points and this makes tracking easier. One bad work around might be if you know the distance of the traffic sign and start your AR app aligned with the sign you can create arbitrary anchors at any points using `Session.createAnchor. However, as i said this will not be a good solution. I can try to help if you provide more information about the use case maybe somehow you can make arbitrary anchors work. Good luck!






            share|improve this answer




























              1














              Answer to your first question is really not easy. Because it is not just detecting a marker or an augmented image but it is tracking these images. So you can gather position and rotation information of the marker as well. Any change in the rotation and the position of the marker can be detected. This is essentially done via extracting feature points and tracking position of these points relative to different pose of the device. My advice to you could be trying HelloAR example and trying to visualize feature points on your marker from 15 yard. This will give you the rough idea why you can not optimize such distances. ARCore is using visual odometry so these feature points play a vital role in tracking. This is probably the reason to your additional question because we do not only need to detect the markers but we also have to track them. Therefore, more optimal points means more feature points and this makes tracking easier. One bad work around might be if you know the distance of the traffic sign and start your AR app aligned with the sign you can create arbitrary anchors at any points using `Session.createAnchor. However, as i said this will not be a good solution. I can try to help if you provide more information about the use case maybe somehow you can make arbitrary anchors work. Good luck!






              share|improve this answer


























                1












                1








                1







                Answer to your first question is really not easy. Because it is not just detecting a marker or an augmented image but it is tracking these images. So you can gather position and rotation information of the marker as well. Any change in the rotation and the position of the marker can be detected. This is essentially done via extracting feature points and tracking position of these points relative to different pose of the device. My advice to you could be trying HelloAR example and trying to visualize feature points on your marker from 15 yard. This will give you the rough idea why you can not optimize such distances. ARCore is using visual odometry so these feature points play a vital role in tracking. This is probably the reason to your additional question because we do not only need to detect the markers but we also have to track them. Therefore, more optimal points means more feature points and this makes tracking easier. One bad work around might be if you know the distance of the traffic sign and start your AR app aligned with the sign you can create arbitrary anchors at any points using `Session.createAnchor. However, as i said this will not be a good solution. I can try to help if you provide more information about the use case maybe somehow you can make arbitrary anchors work. Good luck!






                share|improve this answer













                Answer to your first question is really not easy. Because it is not just detecting a marker or an augmented image but it is tracking these images. So you can gather position and rotation information of the marker as well. Any change in the rotation and the position of the marker can be detected. This is essentially done via extracting feature points and tracking position of these points relative to different pose of the device. My advice to you could be trying HelloAR example and trying to visualize feature points on your marker from 15 yard. This will give you the rough idea why you can not optimize such distances. ARCore is using visual odometry so these feature points play a vital role in tracking. This is probably the reason to your additional question because we do not only need to detect the markers but we also have to track them. Therefore, more optimal points means more feature points and this makes tracking easier. One bad work around might be if you know the distance of the traffic sign and start your AR app aligned with the sign you can create arbitrary anchors at any points using `Session.createAnchor. However, as i said this will not be a good solution. I can try to help if you provide more information about the use case maybe somehow you can make arbitrary anchors work. Good luck!







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Nov 20 '18 at 22:49









                Ali KanatAli Kanat

                8321617




                8321617
































                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Stack Overflow!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53382596%2fhow-to-optimize-ar-markers-for-large-open-spaces%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    這個網誌中的熱門文章

                    Tangent Lines Diagram Along Smooth Curve

                    Yusuf al-Mu'taman ibn Hud

                    Zucchini