World to screen logic

[aloha087]

Hey, I am trying to make an external overlay for Minecraft (proof-of-concept).

I want to make external block overlays in C++ rendered over the top of the game. In order to do this for a target block, I need the screen locations of the 4 block corner point positions in the player's view in XY format.

This position depends on multiple factors including Player Location, Yaw, Pitch, FOV, Monitor Resolution and whether the game is being played in Full Screen or Windowed mode.

It would be great to find a solution - the game is always played in full screen and the monitor resolution is 1920x1080

Can anybody help me with this and show me how I would go about doing it?

Thanks,

aloha087

 

Edited August 12, 2022 by aloha087

[warjort]

What does this have to do with forge?

"This is the support section for those modding with Forge"

[aloha087]

13 minutes ago, warjort said:

What does this have to do with forge?

"This is the support section for those modding with Forge"

The screen locations will be sent to the external overlay via a Forge mod. Forge would be ideal for getting positions also.

[warjort]

 Forge doesn't haven't an api for this. Minecraft itself never really has this information.

You can find a similar question asked (except in reverse) here: https://forums.minecraftforge.net/topic/114283-119-screen-point-xy-to-world-coordinates-xyz

In simplistic terms Minecraft does its world rendering in "world coordinates" only later after it has worked out what should be displayed does it translate it to "screen coordinates".

And what is translated at that point has long since lost its connection to the block abstraction.

 

The assumption that blocks are in some sense cubic or even confined to a 1x1x1 cube is also incorrect.

Try looking a lectern and pay attention to the shape and extent of its hitbox. 🙂 

 

Finally, directly using the opengl java api (instead of Minecraft's rendering api) is strongly discouraged. Calling native code to do it is pretty much the same thing, if not worse.

 

Edited August 12, 2022 by warjort