How do i ignore line “”length of fields (%d)“ % (len(obj), len(dataType.fields)))” in pyspark
up vote
-3
down vote
favorite
I am trying to fix this issue where i am getting
"length of fields (%d)" % (len(obj), len(dataType.fields)))
ValueError: Length of object (200) does not match with length of fields (300)
My question now is how do I ignore this line in pyspark.
python pyspark aws-glue
edited Nov 7 at 15:18
blue-phoenox
3,08181438
asked Nov 7 at 13:33
Shane
1
add a comment |
up vote
-3
down vote
favorite
I am trying to fix this issue where i am getting
"length of fields (%d)" % (len(obj), len(dataType.fields)))
ValueError: Length of object (200) does not match with length of fields (300)
My question now is how do I ignore this line in pyspark.
python pyspark aws-glue
edited Nov 7 at 15:18
blue-phoenox
3,08181438
asked Nov 7 at 13:33
Shane
1
Why not fixing the error in the first place?
– toti08
Nov 7 at 13:35
data which i have is in utf8 format , I decoded it using (utf-8, 'ignore') but still because of certain lines i am not able to process it in pyspark. hence i am getting above error.
– Shane
Nov 7 at 13:57
add a comment |
up vote
-3
down vote
favorite
up vote
-3
down vote
favorite
I am trying to fix this issue where i am getting
"length of fields (%d)" % (len(obj), len(dataType.fields)))
ValueError: Length of object (200) does not match with length of fields (300)
My question now is how do I ignore this line in pyspark.
python pyspark aws-glue
edited Nov 7 at 15:18
blue-phoenox
3,08181438
asked Nov 7 at 13:33
Shane
1
I am trying to fix this issue where i am getting
"length of fields (%d)" % (len(obj), len(dataType.fields)))
ValueError: Length of object (200) does not match with length of fields (300)
My question now is how do I ignore this line in pyspark.
python pyspark aws-glue
python pyspark aws-glue
edited Nov 7 at 15:18
blue-phoenox
3,08181438
asked Nov 7 at 13:33
Shane
1
edited Nov 7 at 15:18
blue-phoenox
3,08181438
asked Nov 7 at 13:33
Shane
1
edited Nov 7 at 15:18
blue-phoenox
3,08181438
edited Nov 7 at 15:18
blue-phoenox
3,08181438
edited Nov 7 at 15:18
blue-phoenox
3,08181438
3,08181438
asked Nov 7 at 13:33
Shane
1
asked Nov 7 at 13:33
Shane
1
asked Nov 7 at 13:33
Shane
1
1
Why not fixing the error in the first place?
– toti08
Nov 7 at 13:35
data which i have is in utf8 format , I decoded it using (utf-8, 'ignore') but still because of certain lines i am not able to process it in pyspark. hence i am getting above error.
– Shane
Nov 7 at 13:57
add a comment |
Why not fixing the error in the first place?
– toti08
Nov 7 at 13:35
data which i have is in utf8 format , I decoded it using (utf-8, 'ignore') but still because of certain lines i am not able to process it in pyspark. hence i am getting above error.
– Shane
Nov 7 at 13:57
Why not fixing the error in the first place?
– toti08
Nov 7 at 13:35
Why not fixing the error in the first place?
– toti08
Nov 7 at 13:35
data which i have is in utf8 format , I decoded it using (utf-8, 'ignore') but still because of certain lines i am not able to process it in pyspark. hence i am getting above error.
– Shane
Nov 7 at 13:57
data which i have is in utf8 format , I decoded it using (utf-8, 'ignore') but still because of certain lines i am not able to process it in pyspark. hence i am getting above error.
– Shane
Nov 7 at 13:57
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
draft saved
draft discarded
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53190499%2fhow-do-i-ignore-line-length-of-fields-d-lenobj-lendatatype-fields%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Why not fixing the error in the first place?
– toti08
Nov 7 at 13:35
data which i have is in utf8 format , I decoded it using (utf-8, 'ignore') but still because of certain lines i am not able to process it in pyspark. hence i am getting above error.
– Shane
Nov 7 at 13:57