Apache Ignite Rest API calls. (Any Ideas about Apache Ignite SDK?)











up vote
0
down vote

favorite












We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML



As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)



My questions:




  1. Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)


  2. Is it possible to send json response to this rest API? If so, How? Examples please.



Thanks for your response. Will help us a lot.










share|improve this question









New contributor




santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




















  • Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
    – Stephen Darlington
    Nov 4 at 11:54










  • How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
    – santhan2594
    Nov 4 at 12:43

















up vote
0
down vote

favorite












We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML



As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)



My questions:




  1. Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)


  2. Is it possible to send json response to this rest API? If so, How? Examples please.



Thanks for your response. Will help us a lot.










share|improve this question









New contributor




santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




















  • Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
    – Stephen Darlington
    Nov 4 at 11:54










  • How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
    – santhan2594
    Nov 4 at 12:43















up vote
0
down vote

favorite









up vote
0
down vote

favorite











We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML



As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)



My questions:




  1. Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)


  2. Is it possible to send json response to this rest API? If so, How? Examples please.



Thanks for your response. Will help us a lot.










share|improve this question









New contributor




santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML



As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)



My questions:




  1. Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)


  2. Is it possible to send json response to this rest API? If so, How? Examples please.



Thanks for your response. Will help us a lot.







rest api spring-boot microservices ignite






share|improve this question









New contributor




santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question









New contributor




santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question








edited Nov 4 at 12:43





















New contributor




santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked Nov 4 at 9:54









santhan2594

12




12




New contributor




santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.












  • Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
    – Stephen Darlington
    Nov 4 at 11:54










  • How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
    – santhan2594
    Nov 4 at 12:43




















  • Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
    – Stephen Darlington
    Nov 4 at 11:54










  • How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
    – santhan2594
    Nov 4 at 12:43


















Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54




Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54












How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43






How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43














1 Answer
1






active

oldest

votes

















up vote
1
down vote













If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.






share|improve this answer





















  • Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
    – santhan2594
    Nov 4 at 19:05











Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});






santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.










 

draft saved


draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53139553%2fapache-ignite-rest-api-calls-any-ideas-about-apache-ignite-sdk%23new-answer', 'question_page');
}
);

Post as a guest
































1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes








up vote
1
down vote













If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.






share|improve this answer





















  • Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
    – santhan2594
    Nov 4 at 19:05















up vote
1
down vote













If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.






share|improve this answer





















  • Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
    – santhan2594
    Nov 4 at 19:05













up vote
1
down vote










up vote
1
down vote









If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.






share|improve this answer












If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.







share|improve this answer












share|improve this answer



share|improve this answer










answered Nov 4 at 13:21









Stephen Darlington

45.2k993141




45.2k993141












  • Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
    – santhan2594
    Nov 4 at 19:05


















  • Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
    – santhan2594
    Nov 4 at 19:05
















Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05




Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05










santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.










 

draft saved


draft discarded


















santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.













santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.












santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.















 


draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53139553%2fapache-ignite-rest-api-calls-any-ideas-about-apache-ignite-sdk%23new-answer', 'question_page');
}
);

Post as a guest




















































































這個網誌中的熱門文章

Tangent Lines Diagram Along Smooth Curve

Yusuf al-Mu'taman ibn Hud

Zucchini