Produce byte-identical executable using the same compiler about devilution HOT 18 CLOSED

from devilution.

I don't know much about this but from efforts in the Linux community (Debian and maybe others) to produce byte identical executables, you will need to remove any type of code that may cause the compiler to generate output that is variable. Things like timestamps used in the compiler and other things will need to be taken into account

Indeed. Timestamps would have to be removed and other parts that are variable from build to build as well. Good thing is those are easily identified.

So one approach would be to simply extract the contents of the .text section and dump that, then compare between the binaries. Of course, initially the output will be very different, and thus hashes can only be used as a final measurement. But before then we can use something like Hamming distance to get a score for how many edits have been made.

We can also keep track of which offsets correspond to which function, and in this way check off one function at the time.

Note, relative offsets to addresses will be variable if the output binary rearranges where code and data is stored, and also depending on the size of these parts.

It most definitely won't be an easy challenge. But, at least to me, that's what makes it fun!

Also, this is not goal number one. That would be to fix crashes, improve stability, fix builds across the main platforms (Windows, Linux, Mac), etc. Rather, this can be thought of as an aspirational goal that Devilution may one day achieve, or perhaps more likely not. But I for one would definitely want to be part of making it happen!

Cheers,
/u

from devilution.

There are already projects like https://github.com/pret/pokeruby or https://github.com/MimicYou/pokeredbeta that build hash-perfect recreations of their originals.

from devilution.

Just make sure this stays as original as possible. I have seen The Hell mod and I thought it was grindingly unbalanced and a weird distortion of what Diablo is.

No worries, this is tracked by #11.

from devilution.

See this comment for a major update!

from devilution.

PS: If I should stop looking for these housekeeping tasks, please tell me ;)

It's great you are looking for housekeeping tasks :) Please continue.

As for this issue, it is similar but slightly different from #111. For instance, there are other issues to consider even when we have exactly the same compiler, such as time stamps being included in the binary. This issue mentions some of those aspects. However, I'd be fine with closing this issue as the primary work now is to get bin perfect assembly, which is tracked by #111 and the bin exact milestone. Later on when we want to figure out specific issues, such as how to handle time stamps, we can open new dedicated issues for those.

Closing for now. We can re-open at a later time, should we feel like.

from devilution.

Oh that's great! I totally forgot about PEiD. So now we know for sure it was 5.10. Thankfully VC 5/6 are very similar and still run on modern systems. I went ahead and made a chart for all versions so we have an easy reference. I'll download 5.10 this next week and configure the project accordingly.

from devilution.

from devilution.

I personally don't a byte for byte copy is possible.

You would literally have the exact code any extra variables or optimizations or anything would completely throw it off.

Mewmew , I respect your energy )

from devilution.

There are already projects like https://github.com/pret/pokeruby or https://github.com/MimicYou/pokeredbeta that build hash-perfect recreations of their originals.

Wow, that is really cool! Thanks for pointing out these projects.

from devilution.

Hey, Diablo is already decompiled and refactored, the project is called The Hell and source code was hosted on Assembla at least in 2013

from devilution.

Hey, Diablo is already decompiled and refactored, the project is called The Hell and source code was hosted on Assembla at least in 2013

@gp-alex That's great! Do you know where this source code is hosted?

from devilution.

You are correct, Hellfire was decompiled as early as 2006 IIRC, and The Hell released their sources a few years ago at the Khandurus network. However, it seems to have completely disappeared from the internet, same with The Dark/Khandurus.

The Hell 2 creator still has a copy. He reached out to me a few days ago and said he might pop in a make a contribution or two.

from devilution.

Just make sure this stays as original as possible. I have seen The Hell mod and I thought it was grindingly unbalanced and a weird distortion of what Diablo is.

from devilution.

What compiler was used to generate the exe in the 0.2 release? I patch between it and Diablo.exe seams to indicate a 60% correlation.

from devilution.

I used VC++ 5.10 for all release builds. The GNU makefiles currently don't properly add the Icon and resource files.

from devilution.

The GNU makefiles currently don't properly add the Icon and resource files.

Added an issue to track this #48.

from devilution.

I think this issue can be closed. It's topic should be exactly the same as #111 which is newer.

PS: If I should stop looking for these housekeeping tasks, please tell me ;)

from devilution.