apache / apache/beam

MapField having null Row value throws NullPointerException during encoding

Open
#19,703 0 comments 0 reactions 0 assignees View on GitHub
bug core java P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Below is the scenario tried:
```

public void testMapWithNullRowAsValue() {

Schema primitiveFieldsScema =
Schema.builder().addNullableField("color",
FieldType.STRING).build();
      
FieldType valueType = FieldType.row(primitiveFieldsScema).withNullable(true);
    
 
Schema inputSchema =
Schema.builder()
.addNullableField("mapWithValueAsRow",

FieldType.map(FieldType.STRING, valueType))
      .build();

Map mapWithValueAsNullRow = new HashMap<>();
mapWithValueAsNullRow.put("key", null); // Setting
value of map as NULL

Row rowOfMap = Row.withSchema(inputSchema)
.addValue(mapWithValueAsNullRow)

.build();

pipeline.apply(Create.of(rowOfMap)).setRowSchema(inputSchema);

pipeline.run().waitUntilFinish(Duration.standardMinutes(1));

}
```

 

Below NPE is seen:
```

java.lang.NullPointerException
    at org.apache.beam.sdk.coders.RowCoderGenerator$EncodeInstruction.encodeDelegate(RowCoderGenerator.java:225)
  
 at org.apache.beam.sdk.coders.Coder$ByteBuddy$DifqoQx1.encode(Unknown Source)
    at org.apache.beam.sdk.coders.Coder$ByteBuddy$DifqoQx1.encode(Unknown
Source)
    at org.apache.beam.sdk.coders.MapCoder.encode(MapCoder.java:96)
    at org.apache.beam.sdk.coders.MapCoder.encode(MapCoder.java:69)
  
 at org.apache.beam.sdk.coders.MapCoder.encode(MapCoder.java:43)
    at org.apache.beam.sdk.coders.RowCoderGenerator$EncodeInstruction.encodeDelegate(RowCoderGenerator.java:234)
  
 at org.apache.beam.sdk.coders.Coder$ByteBuddy$9dwdE80N.encode(Unknown Source)
    at org.apache.beam.sdk.coders.Coder$ByteBuddy$9dwdE80N.encode(Unknown
Source)
    at org.apache.beam.sdk.coders.RowCoder.encode(RowCoder.java:145)
    at org.apache.beam.sdk.schemas.SchemaCoder.encode(SchemaCoder.java:81)
  
 at org.apache.beam.sdk.coders.Coder.encode(Coder.java:136)
    at org.apache.beam.sdk.util.CoderUtils.encodeToSafeStream(CoderUtils.java:82)
  
 at org.apache.beam.sdk.util.CoderUtils.encodeToByteArray(CoderUtils.java:66)
    at org.apache.beam.sdk.util.CoderUtils.encodeToByteArray(CoderUtils.java:51)
  
 at org.apache.beam.sdk.util.CoderUtils.clone(CoderUtils.java:141)
    at org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector.(MutationDetectors.java:113)
  
 at org.apache.beam.sdk.util.MutationDetectors.forValueWithCoder(MutationDetectors.java:44)
    at
org.apache.beam.runners.direct.ImmutabilityCheckingBundleFactory$ImmutabilityEnforcingBundle.add(ImmutabilityCheckingBundleFactory.java:112)
  
 at org.apache.beam.runners.direct.BoundedReadEvaluatorFactory$BoundedReadEvaluator.processElement(BoundedReadEvaluatorFactory.java:151)
  
 at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:160)
  
 at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:124)
  
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
  
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  
 at java.lang.Thread.run(Thread.java:748)

```

Imported from Jira [BEAM-7841](https://issues.apache.org/jira/browse/BEAM-7841). Original Jira may contain additional context.
Reported by: vbm.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.