Apache Ignite Rest API calls. (Any Ideas about Apache Ignite SDK?)
up vote
0
down vote
favorite
We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML
As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)
My questions:
Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)
Is it possible to send json response to this rest API? If so, How? Examples please.
Thanks for your response. Will help us a lot.
rest api spring-boot microservices ignite
asked Nov 4 at 9:54
santhan2594
12
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
up vote
0
down vote
favorite
We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML
As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)
My questions:
Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)
Is it possible to send json response to this rest API? If so, How? Examples please.
Thanks for your response. Will help us a lot.
rest api spring-boot microservices ignite
asked Nov 4 at 9:54
santhan2594
12
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54
How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML
As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)
My questions:
Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)
Is it possible to send json response to this rest API? If so, How? Examples please.
Thanks for your response. Will help us a lot.
rest api spring-boot microservices ignite
asked Nov 4 at 9:54
santhan2594
12
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
We are trying to store data from XML in Apache ignite cache, which is set up in a Kubernates cluster in Azure. We have a spring boot application, added ignite dependency, parsing the XML using jaxb to pojos and storing the data. But the ignite cache put operation is taking a lot of time. ( Because we are dealing with 500K - 1M lines of XML
As an alternative, we trying to use this REST API calls provide by ignite itself in our application. (https://apacheignite.readme.io/docs/rest-api)
My questions:
Does anybody have working example to do this in spring boot? Can it be done using Ignite SDK? (We know we can send get and put request using rest template in spring boot.)
Is it possible to send json response to this rest API? If so, How? Examples please.
Thanks for your response. Will help us a lot.
rest api spring-boot microservices ignite
rest api spring-boot microservices ignite
asked Nov 4 at 9:54
santhan2594
12
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Nov 4 at 9:54
santhan2594
12
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited Nov 4 at 12:43
asked Nov 4 at 9:54
santhan2594
12
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Nov 4 at 9:54
santhan2594
12
asked Nov 4 at 9:54
santhan2594
12
12
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
santhan2594 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54
How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43
add a comment |
Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54
How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43
Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54
Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54
How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43
How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43
add a comment |
1 Answer
1
active
oldest
votes
up vote
1
down vote
If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05
add a comment |
up vote
1
down vote
If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05
add a comment |
up vote
1
down vote
up vote
1
down vote
If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
If your underlying problem is loading 1mm records is too slow, using the REST interface is not the solution. Instead, you should consider using the DataStreamer API, which is designed to ingest large amounts of data. You probably also don't need to convert your XML objects into POJO, but that's an optimisation you might not need right now.
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
answered Nov 4 at 13:21
Stephen Darlington
45.2k993141
45.2k993141
Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05
add a comment |
Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05
Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05
Thank you. I'll try this one out. But if we have to use this REST calls for Ignite from spring boot, we would have to use rest template only from spring boot. Correct? Or is there any other way ?
– santhan2594
Nov 4 at 19:05
add a comment |
santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.
santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.
santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.
santhan2594 is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53139553%2fapache-ignite-rest-api-calls-any-ideas-about-apache-ignite-sdk%23new-answer', 'question_page');
}
);
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Is the question "how do i efficiently load 1mm lines of XML" or "how do I use the REST API"?
– Stephen Darlington
Nov 4 at 11:54
How to use the Apache Ignite Rest api calls from spring boot? And also how to save 1M lines XML efficiently into Ignite cache?
– santhan2594
Nov 4 at 12:43