Getting max() arg is an empty sequence trying custom data.

Hi All,

I am trying to train with sample set.

python ./train.py --dataset_path=sample.json

data input like as below getting below error

File "./train.py", line 43, in pad_dataset
max_l = max(len(x) for x in dataset["input_ids"])
ValueError: max() arg is an empty sequence

Please advice.

{"train":[{"personality":["i like to remodel homes .","i like to go hunting .","i like to shoot a bow .","my favorite holiday is halloween ."],"utterances":[{"candidates":["my mom was single with 3 boys , so we never left the projects .","i try to wear all black every day . it makes me feel comfortable .","well nursing stresses you out so i wish luck with sister","yeah just want to pick up nba nfl getting old","i really like celine dion . what about you ?","no . i live near farms .","i wish i had a daughter , i'm a boy mom . they're beautiful boys though still lucky","yeah when i get bored i play gone with the wind my favorite movie .","hi how are you ? i'm eating dinner with my hubby and 2 kids .","were you married to your high school sweetheart ? i was .","that is great to hear ! are you a competitive rider ?","hi , i'm doing ok . i'm a banker . how about you ?","i'm 5 years old","hi there . how are you today ?","i totally understand how stressful that can be .","yeah sometimes you do not know what you are actually watching","mother taught me to cook ! we are looking for an exterminator .","i enjoy romantic movie . what is your favorite season ? mine is summer .","editing photos takes a lot of work .","you must be very fast . hunting is one of my favorite hobbies ."],"history":["hi , how are you doing ? i'm getting ready to do some cheetah chasing to stay in shape ."]},{"candidates":["hello i am doing well how are you ?","ll something like that . do you play games ?","does anything give you relief ? i hate taking medicine for mine .","i decorate cakes at a local bakery ! and you ?","do you eat lots of meat","i am so weird that i like to collect people and cats","how are your typing skills ?","yeah . i am headed to the gym in a bit to weight lift .","yeah you have plenty of time","metal is my favorite , but i can accept that people listen to country . haha","that's why you desire to be controlled . let me control you person one .","two dogs they are the best , how about you ?","you do art ? what kind of art do you do ?","i love watching baseball outdoors on sunny days .","oh i see . do you ever think about moving ? i do , it is what i want .","sure . i wish it were winter . the sun really hurts my blue eyes .","are we pretending to play tennis","i am rich and have all of my dreams fulfilled already","they tire me so , i probably sleep about 10 hrs a day because of them .","i also remodel homes when i am not out bow hunting ."],"history":["hi , how are you doing ? i'm getting ready to do some cheetah chasing to stay in shape .","you must be very fast . hunting is one of my favorite hobbies .","i am ! for my hobby i like to do canning or some whittling ."]},{"candidates":["yes they do but i say no to them lol","i have trouble getting along with family .","i live in texas , what kind of stuff do you do in toronto ?","that's so unique ! veganism and line dancing usually don't mix !","no , it isn't that big . do you travel a lot","that's because they are real ; what do you do for work ?","i am lazy all day lol . my mom wants me to get a job and move out","i was born on arbor day , so plant a tree in my name","okay , i should not tell you , its against the rules but my name is sarah , call me o","hello how are u tonight","cool . . . my parents love country music that's why i hate it","i am an accountant . what do you do ?","what do your parents do ? my dad is a mechanic .","how are you liking it ?","i really am too . great talking to you too .","cool . whats it like working there ?","one daughter . she's pre med","no and all men is taller than me why can't i find a man to dance with","i live in utah , and my family live in england , so i understand","that's awesome . do you have a favorite season or time of year ?"],"history":["hi , how are you doing ? i'm getting ready to do some cheetah chasing to stay in shape .","you must be very fast . hunting is one of my favorite hobbies .","i am ! for my hobby i like to do canning or some whittling .","i also remodel homes when i am not out bow hunting .","that's neat . when i was in high school i placed 6th in 100m dash !"]},{"candidates":["not really , it is just a small local radio station . what about you , what do you do ?","me too ! people always say i am so organized","niagra fall is where our honeymoon will be","yes ! i know how to be by myself . you ? i do not need new friends . you ?","ll . my dad is a police officer and they have a sports team too","oh you should get your license","okay you have a good day nice talking with you !","i play some ball for a living .","me too ! my asthma is really embarrassing and makes me uncomfortable around others .","netflix and good food is the best . maybe lobster , my favorite seafood . where ya from ?","oh nice . why is that ?","sounds fun ! i helped my wife with health issues , too .","i am a night owl . i think i'll play the piano a little before bed .","just the real ones , not a big game person","i could be the next mrs . adam levine . please , i'll buy you 10 mangoes .","do you like dogs i've usually to talk","what did she teach ? my mom stayed home with my and my 3 older siblings","neither do i , i am just a photographer , and that is already a ot of energy","no , i say i am average at 5 4 . are you vertically challenged ?","what is your favorite meat to eat ?"],"history":["hi , how are you doing ? i'm getting ready to do some cheetah chasing to stay in shape .","you must be very fast . hunting is one of my favorite hobbies .","i am ! for my hobby i like to do canning or some whittling .","i also remodel homes when i am not out bow hunting .","that's neat . when i was in high school i placed 6th in 100m dash !","that's awesome . do you have a favorite season or time of year ?","i do not . but i do have a favorite meat since that is all i eat exclusively ."]},{"candidates":["i am listening to system of a down , i wonder if your cat would like them","i absolutely agree , women are just as strong and capable .","in denmark with my grandma . what about you ?","i live in backcountry michigan . i encounter many sick , injured wildlife daily !","i am great and you","i am a big foodie , i love to bake . how about you ?","dance ! ! i win alot of mone and trifies . . what do u do four fun ?","do you do any sports ? swimming helps me keep my energy up .","they are excellent for the environment .","i am going to catch some fish and think this over . thanks dog !","i am doing well ! how about you ?","i like old cars better new cars are to expensive","i've met bill once . he seems like a nice guy .","oh that is amazing . i've been trying to find someone who can help him","i am in my early 30s , what you do for living","so , you are in college ? i took foreign language in college .","i just turned 30 the other day","what a coincidence i live up in anchorage","that would be interesting . i am going to be a forensic psychologist .","i like chicken or macaroni and cheese ."],"history":["hi , how are you doing ? i'm getting ready to do some cheetah chasing to stay in shape .","you must be very fast . hunting is one of my favorite hobbies .","i am ! for my hobby i like to do canning or some whittling .","i also remodel homes when i am not out bow hunting .","that's neat . when i was in high school i placed 6th in 100m dash !","that's awesome . do you have a favorite season or time of year ?","i do not . but i do have a favorite meat since that is all i eat exclusively .","what is your favorite meat to eat ?","i would have to say its prime rib . do you have any favorite foods ?"]},{"candidates":["that sounds nice . do you make your own ?","i had a simple lunch so that i make my supper heavy after beach .","nice i may be able to beat you my hair is bright purple","not really i am kind of an introvert","well currently i am going to the university of chicago to obtain a law degree","also , my parents came with me , because they are on a break from teaching !","oh , i am sorry . want to come play tennis with my two sisters and me ?","wow ! 2 sons . john and wayne . you play guitar good ?","what do you do all day then ?","i work from home , what about you ?","that is no good . have glasses ?","just chilling . watching netflix . so what are you reading ?","i love food too . especially fine dining .","what do you like to watch ?","i do not have to work anymore , thank goodness","no , not really . i am in kansas .","i love movies . especially disney .","no i do not . what kinds of dogs do you have","they won't , but i'll someday . what are you hobbies ?","i am going to watch football . what are you canning ?"],"history":["hi , how are you doing ? i'm getting ready to do some cheetah chasing to stay in shape .","you must be very fast . hunting is one of my favorite hobbies .","i am ! for my hobby i like to do canning or some whittling .","i also remodel homes when i am not out bow hunting .","that's neat . when i was in high school i placed 6th in 100m dash !","that's awesome . do you have a favorite season or time of year ?","i do not . but i do have a favorite meat since that is all i eat exclusively .","what is your favorite meat to eat ?","i would have to say its prime rib . do you have any favorite foods ?","i like chicken or macaroni and cheese .","do you have anything planned for today ? i think i am going to do some canning ."]},{"candidates":["awesome . so what do you do for a living ?","you are telling the truth lol","haha yea i love cookies . i sleep way to much to . you like music ?","that is nice to know . i travel due to being financially stable .","i am sure you can . california is full of opportunities .","they're fun . i also wanted to be a rock star as i love the music .","you need a hobby something you can do in small segments at night","hi , i love halloween , so what do you like to do for fun ?","is that a long movie ? few hours ? that is what i spend at the pool","tennis sounds interesting ! yes , i am ! how about you ?","very well , thank you . how are you today ?","i like a cashier at my bank . i stare at her at a distance to flirt .","yes . thank you for the chat .","that is super sweet , high school sweetheart kind of thing","hey . my favorite color is pink . how about you ?","nice ! i don't go out much because i am busy at my accounting job .","oh my gosh i don't know what i'd do if i had to get a job !","that would still be buying it online !","was okay . dog woke me up and just getting ready for a date .","if i have time outside of hunting and remodeling homes . which is not much !"],"history":["hi , how are you doing ? i'm getting ready to do some cheetah chasing to stay in shape .","you must be very fast . hunting is one of my favorite hobbies .","i am ! for my hobby i like to do canning or some whittling .","i also remodel homes when i am not out bow hunting .","that's neat . when i was in high school i placed 6th in 100m dash !","that's awesome . do you have a favorite season or time of year ?","i do not . but i do have a favorite meat since that is all i eat exclusively .","what is your favorite meat to eat ?","i would have to say its prime rib . do you have any favorite foods ?","i like chicken or macaroni and cheese .","do you have anything planned for today ? i think i am going to do some canning .","i am going to watch football . what are you canning ?","i think i will can some jam . do you also play footfall for fun ?"]}]},{"personality":["my mom is my best friend .","i have four sisters .","i believe that mermaids are real .","i love iced tea ."],"utterances":[{"candidates":["there was one person better than me , but i will keep trying to pass","oh that's a yummy jpb","i take it you are not getting along with him ?","ah , i prefer asian cuisine , especially thai food .","awesome my kids and brothers love it","just dropped pizza on my suspense novel . two faves ruined at once !","no boots unfortunately . i sell my homemade candles","i am well . how are you doing ?","cool ! does your husband like to read ? i love to .","officer bob here . good . i am relaxing from a long day being an officer of the law .","cool ! so what do you look like ?","i am a bit of a loner . i live by myself . no attachments .","i have to cut my long beard . it might slow me down !","i have some sports cars .","i do listen to music and i love to cook .","its great that you dance . its very enjoyable","most i know about trucker comes from watching ice road truckers and burt reynolds films lol","good . where are you from ?","right now i am doing an ocean liner .","i am spending time with my 4 sisters what are you up to"],"history":["hi , how are you doing today ?"]},{"candidates":["that would be great . what do you do on the weekends ?","i am sorry to hear about that . i am not married .","hello ! i just got done taking my daily blood sugar level . yuck !","they really are . and a handful at times","what kind o music do you like","it was nice chatting with you also . glad it was a formal situation .","i am all about driving , fast and furious !","kind of , i just love to eat fruit","i am attending hesston college","fall and winter are my favorite ! no i am unemployed right now .","yeah you should , that can be tricky .","that is cool . what do you do for fun ?","take care and i hope you do well in college !","that is cool . i am scared of heights","only the one i left at the truck stop . you ?","oh yes for sure that is great .","hey there how are you today ?","ah manic depressive . how to you cope ? meditation ? any hobbies ?","hey ! what kind of music are your into ?","that is a good show i watch that while drinking iced tea"],"history":["hi , how are you doing today ?","i am spending time with my 4 sisters what are you up to","wow , four sisters . just watching game of thrones ."]},{"candidates":["very long , she was with me when i colored my hair pink","i like being alone and hitchhiking","hi , how are you doing today ?","actually been good and better than what i expected","ah , wrong ! blue is my fav color . what hobbies do you have ?","i'm great , loving this city life , how are you ?","that's true . i have supporting parents , i'm grateful for that .","just started working from home , the internet is a heck of a thing","the tallest sunflowers you have ever seen are over their graves","i bet . what do you drive ? i have a cool , black car .","i will be headed to paris on vacation to visit my sister","i live in new york and you ?","i understand . i like to work out alone","i'm eric . i'm from new york . my dad drove cab here in the seventies .","i sing sometimes too . i used to do a lot of musical theatre .","i rather see it in a cartoon lol i know that's fake","that would be great pay","my name is charlie . what kind of earrings ?","of course . i'm listening .","i'm a researcher i'm researching the fact that mermaids are real"],"history":["hi , how are you doing today ?","i am spending time with my 4 sisters what are you up to","wow , four sisters . just watching game of thrones .","that is a good show i watch that while drinking iced tea","i agree . what do you do for a living ?"]},{"candidates":["hi there , i'm bob .","i know a bit about food . my folks have a small grocery","hey , that's life . what about you , what do you do ?","i like that too . if i win the lottery , i could go anywhere !","what do you do for fun ?","no not me , i don't like to show out , like driving a mercedes . kidding","yeah it relaxes me when i'm stressed out","i left my chevy duramax running while at american eagle . sale !","yes , you'll treat when i fall sick","how do you do that ?","good comparison ! ! that's actually a flattering comparison for me .","now i do it like a nerd","i'm with you there for sure .","girls are gross boys rule","cute ! my father owns bees as pets , but i'm allergic to them .","congrats ! nothing that great in my life","i'm very healthy i live in a farm , what is wrong with your health ?","how come ? conserving energy ? whats going on","it is so late but that's cool i bet they look nice .","that's cool my mom does the same thing"],"history":["hi , how are you doing today ?","i am spending time with my 4 sisters what are you up to","wow , four sisters . just watching game of thrones .","that is a good show i watch that while drinking iced tea","i agree . what do you do for a living ?","i'm a researcher i'm researching the fact that mermaids are real","interesting . i'm a website designer . pretty much spend all my time on the computer ."]},{"candidates":["love that too . i'm waiting on my car to be fixed . you ?","at least he helps you . do you cook bake ?","no , i auditioned as a child but i failed horribly .","i love cheese and ham sandwiches","a poodle , he is hard to look after as he is so big , i'm quite small","hello , i believe in things i can touch and see . so . . .","it is a beautiful day outside no rain here ?","is english your first language ?","my wife does when we take our sunday drives","oh , one day may . i wonder the same .","its hard for me to relive . it involved bread and a defective oven .","hello there ! how are you doing ?","i swear i'm losing my freaking mind .","that sounds yummy . i enjoy soccer . do you work ?","i see . i'm just trying to become a vegetarian . are you ?","great , i'll love it so much","wow happy anniversary to you and him .","i enjoy playing tennis and baking .","and what is that then","tell me more about yourself"],"history":["hi , how are you doing today ?","i am spending time with my 4 sisters what are you up to","wow , four sisters . just watching game of thrones .","that is a good show i watch that while drinking iced tea","i agree . what do you do for a living ?","i'm a researcher i'm researching the fact that mermaids are real","interesting . i'm a website designer . pretty much spend all my time on the computer .","that's cool my mom does the same thing","that's awesome . i have always had a love for technology ."]},{"candidates":["hello , i play with my iguanas and dogs .","ok stressful . my girlfriend and i broke up","oh cool ! ! i really like music and singing","i tour with a band , maybe you could do something like that .","what kind of music do you like ?","i'm sorry to hear that ! we all have issues . my feet sometimes smell bad after work .","that's interesting . i guess the weirdest thing about me is i do not work","i sometimes do not eat very healthy foods .","awesome ! do you have a favorite hero ?","i'm not married , but take care of my three roommates","hi there , how are you tonight ?","the traffic is terrible but i've my favorite books to keep me company","hello ! how are you doing today ?","that's creepy . do you like video games ? i love them .","i love mystery and thriller novels ! you should give them a try .","i watch a lot of kid shows got my start with voice overs with sesame street .","i'm good getting ready to volunteer","nah he's chill he's a california puppy hell just make fun of you","nothing , i just do not want a normal life","i enjoy hanging with my mother she's my best friend"],"history":["hi , how are you doing today ?","i am spending time with my 4 sisters what are you up to","wow , four sisters . just watching game of thrones .","that is a good show i watch that while drinking iced tea","i agree . what do you do for a living ?","i'm a researcher i'm researching the fact that mermaids are real","interesting . i'm a website designer . pretty much spend all my time on the computer .","that's cool my mom does the same thing","that's awesome . i have always had a love for technology .","tell me more about yourself","i really enjoy free diving , how about you , have any hobbies ?"]},{"candidates":["what sort of events do you normally photograph ?","the minnesota wolves . i'm filthy rich .","hope so my class is taking a trip there end of the year","tell me something about you","i like to spend the time in concerts . whats the kids fav . color in school ?","i bet . what do you do for fun ?","cool i own a company come work for me","yes it is . whistling reminds me of the walking dead tv show .","i'm ok wish my allergy medicine would kick in","i'm good and you ?","hey hows it going , tell me something about yourself","i got into the habit in the hospital . had two toes amputated in an accident .","great thank you . and yourself ?","just watching football . i'm a hugeeee nfl fan .","i have been blessed for sure . what kind of music do you like ?","not school . i teach aerobics and yoga classes .","i will make those dogs look majestic . in the afternoon though , for i sleep late .","i don't , i wish i did tho . i'm trying not to relapse","oh okay . why ? i like riding horses do you ?","i'm also fascinated with mermaids"],"history":["hi , how are you doing today ?","i am spending time with my 4 sisters what are you up to","wow , four sisters . just watching game of thrones .","that is a good show i watch that while drinking iced tea","i agree . what do you do for a living ?","i'm a researcher i'm researching the fact that mermaids are real","interesting . i'm a website designer . pretty much spend all my time on the computer .","that's cool my mom does the same thing","that's awesome . i have always had a love for technology .","tell me more about yourself","i really enjoy free diving , how about you , have any hobbies ?","i enjoy hanging with my mother she's my best friend","that's nice . moms are pretty cool too ."]}]}]}

Start with train.py, especially pad_dataset at line 43, and inspect how sample.json is loaded and converted into dataset["input_ids"]. Run the reported training command with the sample file; done means valid custom data produces a non-empty input_ids sequence and training proceeds without the max() error.