bevyengine / bevyengine/bevy

Instance example magically inherits transform information of a random entity if any number of new pbr bundles is spawned

Open
#15,160 8 comments 0 reactions 0 assignees View on GitHub
A-Rendering C-Bug D-Complex S-Needs-Investigation
Dominant language
Rust
Stars
48.2k
Forks
4.8k
Avg merge
3d 22h
Merged PRs (30d)
161

Description

## Bevy version

0.14.2

## \[Optional\] Relevant system information

Windows 11

[Nvidia RTX A2000 8gb laptop GPU, vendor: 4318, device: 9658, device_type: DiscreteGpu, driver: "Nvidia", driver_info: "536.67", backend: Vulkan]

## What you did

I ran the rendering example https://bevyengine.org/examples-webgpu/shaders/shader-instancing/ and added a new spherical pbr bundle (full code listing later)

```
commands.spawn(PbrBundle {
mesh: meshes.add(Sphere::new(0.2727).mesh().uv(10, 10)),
material: materials.add(Color::linear_rgb(1.0, 1.0, 1.0)),
transform: Transform::from_translation(
Vec3::new(-5.0, 0.0, 0.0),
),
..default()
});
```

## What went wrong

What I expected: the default centered instanced example to display, with out moving.
What actually happened: The instancing example somehow inherited the transform information of that new bundle, and adding it before or after the instanced example bundle doesn't change the result.

## Additional information

Where I expected the instance example to render:
![image](https://github.com/user-attachments/assets/19af8a66-b4c2-4a33-ba02-03a726537589)

Where it ended up rendering (centered on sphere):

![image](https://github.com/user-attachments/assets/8642cc11-01ab-4664-acef-c785bec4d536)

Source code:

src/main.rs:
```

//! A shader that renders a mesh multiple times in one draw call.

use bevy::{
core_pipeline::core_3d::Transparent3d,
ecs::{
query::QueryItem,
system::{lifetimeless::*, SystemParamItem},
},
pbr::{
MeshPipeline, MeshPipelineKey, RenderMeshInstances, SetMeshBindGroup, SetMeshViewBindGroup,
},
prelude::*,
render::{
extract_component::{ExtractComponent, ExtractComponentPlugin},
mesh::{GpuBufferInfo, GpuMesh, MeshVertexBufferLayoutRef},
render_asset::RenderAssets,
render_phase::{
AddRenderCommand, DrawFunctions, PhaseItem, PhaseItemExtraIndex, RenderCommand,
RenderCommandResult, SetItemPipeline, TrackedRenderPass, ViewSortedRenderPhases,
},
render_resource::*,
renderer::RenderDevice,
view::{ExtractedView, NoFrustumCulling},
Render, RenderApp, RenderSet,
},
};
use bytemuck::{Pod, Zeroable};

fn main() {
App::new()
.add_plugins((DefaultPlugins, CustomMaterialPlugin))
.add_systems(Startup, setup)
.run();
}

fn setup(mut commands: Commands, mut meshes: ResMut>,
mut materials: ResMut>) {
commands.spawn((
meshes.add(Cuboid::new(0.5, 0.5, 0.5)),
SpatialBundle::INHERITED_IDENTITY,
InstanceMaterialData(
(1..=10)
.flat_map(|x| (1..=10).map(move |y| (x as f32 / 10.0, y as f32 / 10.0)))
.map(|(x, y)| InstanceData {
position: Vec3::new(x * 10.0 - 5.0, y * 10.0 - 5.0, 0.0),
scale: 1.0,
color: LinearRgba::from(Color::hsla(x * 360., y, 0.5, 1.0)).to_f32_array(),
})
.collect(),
),
// NOTE: Frustum culling is done based on the Aabb of the Mesh and the GlobalTransform.
// As the cube is at the origin, if its Aabb moves outside the view frustum, all the
// instanced cubes will be culled.
// The InstanceMaterialData contains the 'GlobalTransform' information for this custom
// instancing, and that is not taken into account with the built-in frustum culling.
// We must disable the built-in frustum culling by adding the `NoFrustumCulling` marker
// component to avoid incorrect culling.
NoFrustumCulling,
));

// camera
commands.spawn(Camera3dBundle {
transform: Transform::from_xyz(0.0, 0.0, 15.0).looking_at(Vec3::ZERO, Vec3::Y),
..default()
});

commands.spawn(PbrBundle {
mesh: meshes.add(Sphere::new(0.2727).mesh().uv(10, 10)),
material: materials.add(Color::linear_rgb(1.0, 1.0, 1.0)),
transform: Transform::from_translation(
Vec3::new(-5.0, 0.0, 0.0),
),
..default()
});
}

#[derive(Component, Deref)]
struct InstanceMaterialData(Vec);

impl ExtractComponent for InstanceMaterialData {
type QueryData = &'static InstanceMaterialData;
type QueryFilter = ();
type Out = Self;

fn extract_component(item: QueryItem<'_, Self::QueryData>) -> Option {
Some(InstanceMaterialData(item.0.clone()))
}
}

struct CustomMaterialPlugin;

impl Plugin for CustomMaterialPlugin {
fn build(&self, app: &mut App) {
app.add_plugins(ExtractComponentPlugin::::default());
app.sub_app_mut(RenderApp)
.add_render_command::()
.init_resource::>()
.add_systems(
Render,
(
queue_custom.in_set(RenderSet::QueueMeshes),
prepare_instance_buffers.in_set(RenderSet::PrepareResources),
),
);
}

fn finish(&self, app: &mut App) {
app.sub_app_mut(RenderApp).init_resource::();
}
}

#[derive(Clone, Copy, Pod, Zeroable)]
#[repr(C)]
struct InstanceData {
position: Vec3,
scale: f32,
color: [f32; 4],
}

#[allow(clippy::too_many_arguments)]
fn queue_custom(
transparent_3d_draw_functions: Res>,
custom_pipeline: Res,
msaa: Res,
mut pipelines: ResMut>,
pipeline_cache: Res,
meshes: Res>,
render_mesh_instances: Res,
material_meshes: Query>,
mut transparent_render_phases: ResMut>,
mut views: Query<(Entity, &ExtractedView)>,
) {
let draw_custom = transparent_3d_draw_functions.read().id::();

let msaa_key = MeshPipelineKey::from_msaa_samples(msaa.samples());

for (view_entity, view) in &mut views {
let Some(transparent_phase) = transparent_render_phases.get_mut(&view_entity) else {
continue;
};

let view_key = msaa_key | MeshPipelineKey::from_hdr(view.hdr);
let rangefinder = view.rangefinder3d();
for entity in &material_meshes {
let Some(mesh_instance) = render_mesh_instances.render_mesh_queue_data(entity) else {
continue;
};
let Some(mesh) = meshes.get(mesh_instance.mesh_asset_id) else {
continue;
};
let key =
view_key | MeshPipelineKey::from_primitive_topology(mesh.primitive_topology());
let pipeline = pipelines
.specialize(&pipeline_cache, &custom_pipeline, key, &mesh.layout)
.unwrap();
transparent_phase.add(Transparent3d {
entity,
pipeline,
draw_function: draw_custom,
distance: rangefinder.distance_translation(&mesh_instance.translation),
batch_range: 0..1,
extra_index: PhaseItemExtraIndex::NONE,
});
}
}
}

#[derive(Component)]
struct InstanceBuffer {
buffer: Buffer,
length: usize,
}

fn prepare_instance_buffers(
mut commands: Commands,
query: Query<(Entity, &InstanceMaterialData)>,
render_device: Res,
) {
for (entity, instance_data) in &query {
let buffer = render_device.create_buffer_with_data(&BufferInitDescriptor {
label: Some("instance data buffer"),
contents: bytemuck::cast_slice(instance_data.as_slice()),
usage: BufferUsages::VERTEX | BufferUsages::COPY_DST,
});
commands.entity(entity).insert(InstanceBuffer {
buffer,
length: instance_data.len(),
});
}
}

#[derive(Resource)]
struct CustomPipeline {
shader: Handle,
mesh_pipeline: MeshPipeline,
}

impl FromWorld for CustomPipeline {
fn from_world(world: &mut World) -> Self {
let mesh_pipeline = world.resource::();

CustomPipeline {
shader: world.load_asset("shaders/instancing.wgsl"),
mesh_pipeline: mesh_pipeline.clone(),
}
}
}

impl SpecializedMeshPipeline for CustomPipeline {
type Key = MeshPipelineKey;

fn specialize(
&self,
key: Self::Key,
layout: &MeshVertexBufferLayoutRef,
) -> Result {
let mut descriptor = self.mesh_pipeline.specialize(key, layout)?;

descriptor.vertex.shader = self.shader.clone();
descriptor.vertex.buffers.push(VertexBufferLayout {
array_stride: std::mem::size_of::() as u64,
step_mode: VertexStepMode::Instance,
attributes: vec![
VertexAttribute {
format: VertexFormat::Float32x4,
offset: 0,
shader_location: 3, // shader locations 0-2 are taken up by Position, Normal and UV attributes
},
VertexAttribute {
format: VertexFormat::Float32x4,
offset: VertexFormat::Float32x4.size(),
shader_location: 4,
},
],
});
descriptor.fragment.as_mut().unwrap().shader = self.shader.clone();
Ok(descriptor)
}
}

type DrawCustom = (
SetItemPipeline,
SetMeshViewBindGroup<0>,
SetMeshBindGroup<1>,
DrawMeshInstanced,
);

struct DrawMeshInstanced;

impl RenderCommand

for DrawMeshInstanced {
type Param = (SRes>, SRes);
type ViewQuery = ();
type ItemQuery = Read;

#[inline]
fn render<'w>(
item: &P,
_view: (),
instance_buffer: Option<&'w InstanceBuffer>,
(meshes, render_mesh_instances): SystemParamItem<'w, '_, Self::Param>,
pass: &mut TrackedRenderPass<'w>,
) -> RenderCommandResult {
let Some(mesh_instance) = render_mesh_instances.render_mesh_queue_data(item.entity())
else {
return RenderCommandResult::Failure;
};
let Some(gpu_mesh) = meshes.into_inner().get(mesh_instance.mesh_asset_id) else {
return RenderCommandResult::Failure;
};
let Some(instance_buffer) = instance_buffer else {
return RenderCommandResult::Failure;
};

pass.set_vertex_buffer(0, gpu_mesh.vertex_buffer.slice(..));
pass.set_vertex_buffer(1, instance_buffer.buffer.slice(..));

match &gpu_mesh.buffer_info {
GpuBufferInfo::Indexed {
buffer,
index_format,
count,
} => {
pass.set_index_buffer(buffer.slice(..), 0, *index_format);
pass.draw_indexed(0..*count, 0, 0..instance_buffer.length as u32);
}
GpuBufferInfo::NonIndexed => {
pass.draw(0..gpu_mesh.vertex_count, 0..instance_buffer.length as u32);
}
}
RenderCommandResult::Success
}
}
```

assets/shaders/instancing.wgsl:

```
#import bevy_pbr::mesh_functions::{get_world_from_local, mesh_position_local_to_clip}

struct Vertex {
@location(0) position: vec3,
@location(1) normal: vec3,
@location(2) uv: vec2,

@location(3) i_pos_scale: vec4,
@location(4) i_color: vec4,
};

struct VertexOutput {
@builtin(position) clip_position: vec4,
@location(0) color: vec4,
};

@vertex
fn vertex(vertex: Vertex) -> VertexOutput {
let position = vertex.position * vertex.i_pos_scale.w + vertex.i_pos_scale.xyz;
var out: VertexOutput;
// NOTE: Passing 0 as the instance_index to get_world_from_local() is a hack
// for this example as the instance_index builtin would map to the wrong
// index in the Mesh array. This index could be passed in via another
// uniform instead but it's unnecessary for the example.
out.clip_position = mesh_position_local_to_clip(
get_world_from_local(0u),
vec4(position, 1.0)
);
out.color = vertex.i_color;
return out;
}

@fragment
fn fragment(in: VertexOutput) -> @location(0) vec4 {
return in.color;
}
```

Cargo.toml:

```
[package]
name = "bevy_instance_test"
version = "0.1.0"
edition = "2021"

[dependencies]
bevy = "0.14.2"
bytemuck ="*"
```

I've tested this with manually setting transforms in the spatial bundle for the example, and it *still* doesn't work properly. The only thing I can think of is maybe the spatial bundle transform doesn't get sent to the Render phase, but the PBR bundle transform does, so maybe the default information just appears like it works when nothing is added, but when a PBR bundle is added, the transform uniform is overwritten for the spatial bundle instance as well when rendering. Waaaay too complicated for me to figure out though.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.