Vector35 / Vector35/binaryninja-api

[x86] [sysv] returned structures more than register width should be passed in rdi

Open
#8,426 13 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Core: Calling Convention
Dominant language
C++
Stars
1.3k
Forks
298
Avg merge
5d 5h
Merged PRs (30d)
19

Description

Struct `Class::method`(class Class* `this`)

where sizeof(Struct) > REG_SIZE must be handled as

void `Class::method`(Struct& ret, class Class* `this`)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the x86 SysV ABI handling for returned structures and trace how the method signature is represented. Compare the behavior for structures at and above register width, then verify that oversized returns are represented with the return reference in rdi before this; done means the displayed signature matches the requested form.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
compilers, reverse-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.