Decompilation of Paper Mario - Mirror of https://github.com/pmret/papermario
Go to file
2020-11-19 03:32:34 -05:00
.github/workflows fix doxygen 2020-10-20 21:40:49 +01:00
.vscode revert settings change 2020-11-10 15:24:09 -05:00
asm decompile more entity funcs, split new file 2020-11-19 03:31:22 -05:00
docs merge 2020-11-07 12:33:18 +00:00
include decompile more entity funcs, split new file 2020-11-19 03:31:22 -05:00
src decompile more entity funcs, split new file 2020-11-19 03:31:22 -05:00
tools Merge branch 'master' of https://github.com/ethteck/papermario into entity_funcs 2020-11-19 03:32:34 -05:00
.clang-tidy lint identifier names 2020-10-21 16:51:58 +01:00
.editorconfig new makefile 2020-10-23 01:28:24 +01:00
.gitattributes tell github *.h files are written in C 2020-08-17 13:45:46 +01:00
.gitignore split and compile messages 2020-11-07 01:09:11 +00:00
.gitmodules remove star-rod 2020-10-25 00:49:09 +01:00
checksum.sha1 Refactoring stuff 2020-08-12 21:56:23 -04:00
coverage.py hotfix coverage.py bytes listing 2020-10-20 20:47:29 +01:00
diff_settings.py watch includes 2020-10-28 21:34:04 +00:00
diff.py saving for later 2020-10-02 02:07:54 -04:00
docker-compose.yml gud changes 2020-04-24 00:26:17 -04:00
docker-sync.yml gud changes 2020-04-24 00:26:17 -04:00
Dockerfile Update Dockerfile 2020-05-12 00:45:15 -04:00
Doxyfile implement SCRIPT(...) dsl 2020-10-22 05:54:03 +01:00
format.sh format 2020-11-08 19:22:00 +00:00
install.sh install python-setuptools 2020-10-30 20:33:06 +00:00
Jenkinsfile Jenkins test 3 2020-08-15 00:20:15 -04:00
Makefile split PaperMarioMessages 2020-11-07 14:55:16 +00:00
README.md Merge pull request #101 from nanaian/make 2020-10-28 18:31:57 -04:00
requirements_extra.txt Update install.sh to include the dependencies of diff.py for --extra 2020-10-15 16:02:52 +09:00
requirements.txt Merge branch 'master' into asm-update 2020-11-02 00:17:17 -05:00
sources.mk split and compile messages 2020-11-07 01:09:11 +00:00
undefined_funcs.txt cleanup 2020-10-17 22:39:30 -04:00
undefined_syms.txt decompile more entity funcs, split new file 2020-11-19 03:31:22 -05:00

Paper Mario

This is a WIP decompilation of Paper Mario (USA). It builds the following ROM:

  • papermario.z64 md5: a722f8161ff489943191330bf8416496

Discord: Paper Mario Modding

Setup

You'll need Linux, a Linux VM, or Windows 10 (WSL2) to work on this project.

Clone the repository

$ git clone https://github.com/ethteck/papermario.git
$ cd papermario

Install build dependencies

$ ./install.sh

Our install script does not yet support distros other than Ubuntu, Arch, and their derivatives. Please consider contributing to the script if you use another distro!

Base ROM

You'll need a Paper Mario (USA) ROM to work on this project. Copy it into the root directory of the repository with the name baserom.z64.

Install tools and extract ROM

$ make setup

Compile the game

$ make

If you get OK, you're all set! Otherwise, please feel free to reach out to us in our Discord channel.

Contributing

Dependencies

There are a few additional dependencies needed when contributing to this project. You can install them with ./install.sh --extra.

WSL

We provide windows_terminal.bat to open a Windows Terminal with a recommended layout. Make sure a default distro (e.g. wsl --set-default ubuntu) is set beforehand.

Rebuilding

If you use Visual Studio Code, you can use Run Build Task (Ctrl+Shift+B) to run make. Any errors or warnings generated by the compiler will show up in the Problems tab.

Matching a function

Setup

Once you've created a successful (OK) build, copy build/ to expected/build/:

$ mkdir -p expected
$ cp -r build expected

Roughly converting assembly to C

Decide on a function to match. These can be found in the subdirectories of asm/nonmatchings/. Currently, functions which use float constants, data sections, or jump tables are unmatchable.

Take the relevant .s file and pass it to mips_to_c (web version).

You can also use mips_to_c locally installed to a destination of your choice. Then register a function in ~/.bashrc that calls path/to/mips_to_c.py (with args):

sudo apt update
sudo apt install python3-pip
sudo git clone https://github.com/matt-kempster/mips_to_c.git path/to/mips_to_c

Here's a starter function you can use:

# don't forget to replace /path/to/mips_to_c with your path
function mipstoc() {
    if [ "$#" -gt 1 ]; then
        /path/to/mips_to_c/mips_to_c.py $@;
    else
        printf "Please call mipstoc using this format and make sure you're at the repo root:";
        printf "\nmipstoc \033[0;31marg1 - the nonmatching asm file\033[0m \033[0;34marg2 - the target function\033[0m \033[0;33margN - any of the optional mips_to_c.py flags\033[0m";
        printf "\nmipstoc \033[0;31m./asm/nonmatchings/code_13870_len_6980/func_8003B3D0.s\033[0m \033[0;34mfunc_8003B3D0\033[0m \033[0;33m--flag1 --flag2 --flagN\033[0m\n";
        /path/to/mips_to_c/mips_to_c.py;
    fi
}
export -f mipstoc

Open up the relevant .c file and replace the function's INCLUDE_ASM macro with the output from mips_to_c. Run the following command to attempt to compile, replacing function_name with the name of the function you're working with:

./diff.py -mwo function_name

Fix any errors and rerun diff.py. This will involve typing the function signature correctly, which you will probably find in Star Rod's library database. See also common_structs.h.

Once a successful build is made, diff.py will show you the difference between the original game's assembly (on the left) and what your C code generated (on the right).

Matching the function

You're on your own now. Get your C code compiling to match the original assembly! diff.py, when running, will automatically recompile your code whenever you save the .c file.

If you use Visual Studio Code, you can use Run Test Task to run diff.py and show you errors and warnings from the compiler inline. You might want to attach Run Test Task to a keybinding, as you'll be using it often.

After matching

Once you've matched a function, run the following scripts:

$ ./coverage.py --delete-matched
$ ./format.sh

If format.sh has any problems with your code, go and fix the issues. If you can't fix a warning without making the function not match anymore, append // NOLINT to the offending line.

Troubleshooting

  • If you are using Windows, you may encounter the following when you run make:
sha1sum -c checksum.sha1
sha1sum: 'papermario.z64'$'\r': No such file or directory
: FAILED open or read
sha1sum: WARNING: 1 listed file could not be read
Makefile:118: recipe for target 'verify' failed
make: *** [verify] Error 1

💡 Solution

Run git checkout checksum.sha1 and retry building. Windows has different line endings than Linux, causing some of our tools to break.