Decompilation of Paper Mario - Mirror of https://github.com/pmret/papermario
Go to file
2020-10-20 04:31:25 +01:00
.github/workflows fix coverage, remove extraneous nusys asm 2020-10-14 21:48:16 +01:00
.vscode Fix coverage.py 2020-10-15 18:42:54 -04:00
asm begin script disassembly 2020-10-19 22:58:57 +01:00
include add NPC_GROUP macro 2020-10-20 04:29:42 +01:00
src add NPC_GROUP macro 2020-10-20 04:29:42 +01:00
tools add structs/macros for matching map data 2020-10-20 04:11:07 +01:00
.clang-tidy fix lint failing on first commit to branch 2020-10-13 20:53:45 +01:00
.editorconfig decode assets fs 2020-10-18 04:54:32 +01:00
.gitattributes tell github *.h files are written in C 2020-08-17 13:45:46 +01:00
.gitignore decode assets fs 2020-10-18 04:54:32 +01:00
.gitmodules remove n64splitter submodule 2020-08-20 17:19:22 +01:00
checksum.sha1 Refactoring stuff 2020-08-12 21:56:23 -04:00
coverage.py consider function size in coverage output (#81) 2020-10-19 13:46:55 -04:00
diff_settings.py meow 2020-08-12 22:56:47 -04:00
diff.py saving for later 2020-10-02 02:07:54 -04:00
docker-compose.yml gud changes 2020-04-24 00:26:17 -04:00
docker-sync.yml gud changes 2020-04-24 00:26:17 -04:00
Dockerfile Update Dockerfile 2020-05-12 00:45:15 -04:00
format.sh near-match ActorSpeak 2020-10-17 21:21:57 +01:00
install.sh Update install.sh to include the dependencies of diff.py for --extra 2020-10-15 16:02:52 +09:00
Jenkinsfile Jenkins test 3 2020-08-15 00:20:15 -04:00
Makefile begin script disassembly 2020-10-19 22:58:57 +01:00
README.md move windows_terminal.bat instructions 2020-10-13 19:49:08 +01:00
requirements_extra.txt Update install.sh to include the dependencies of diff.py for --extra 2020-10-15 16:02:52 +09:00
requirements.txt drop pycparser dependency 2020-10-19 07:20:17 +01:00
undefined_funcs.txt cleanup 2020-10-17 22:39:30 -04:00
undefined_syms.txt begin script disassembly 2020-10-19 22:58:57 +01:00

Paper Mario

This is a WIP decompilation of Paper Mario (USA). It builds the following ROM:

  • papermario.z64 md5: a722f8161ff489943191330bf8416496

Discord: Paper Mario Modding

Setup

You'll need Linux, a Linux VM, or Windows 10 (WSL2) to work on this project.

Clone the repository

$ git clone https://github.com/ethteck/papermario.git
$ cd papermario

Install build dependencies

$ ./install.sh

Our install script does not yet support distros other than Ubuntu, Arch, and their derivatives. Please consider contributing to the script if you use another distro!

Base ROM

You'll need a Paper Mario (USA) ROM to work on this project. Copy it into the root directory of the repository with the name baserom.z64.

Install tools and extract ROM

$ make setup

Compile the game

$ make

If you get OK, you're all set! Otherwise, please feel free to reach out to us in our Discord channel.

Contributing

Dependencies

There are a few additional dependencies needed when contributing to this project. You can install them with ./install.sh --extra.

WSL

We provide windows_terminal.bat to open a Windows Terminal with a recommended layout. Make sure a default distro (e.g. wsl --set-default ubuntu) is set beforehand.

Rebuilding

Setting the PM_HEADER_REBUILD environment variable will cause make to rebuild all .c files whenever a .h file is modified.

$ PM_HEADER_REBUILD=1 make

If you use Visual Studio Code, you can use Run Build Task (Ctrl+Shift+B) to run make. Any errors or warnings generated by the compiler will show up in the Problems tab.

Matching a function

Setup

Once you've created a successful (OK) build, copy build/ to expected/build/:

$ mkdir -p expected
$ cp -r build expected

Roughly converting assembly to C

Decide on a function to match. These can be found in the subdirectories of asm/nonmatchings/. Currently, functions which use float constants, data sections, or jump tables are unmatchable.

Take the relevant .s file and pass it to mips_to_c (web version).

You can also use mips_to_c locally installed to a destination of your choice. Then register a function in ~/.bashrc that calls path/to/mips_to_c.py (with args):

sudo apt update
sudo apt install python3-pip
sudo git clone https://github.com/matt-kempster/mips_to_c.git path/to/mips_to_c

Here's a starter function you can use:

# don't forget to replace /path/to/mips_to_c with your path
function mipstoc() {
    if [ "$#" -gt 1 ]; then
        /path/to/mips_to_c/mips_to_c.py $@;
    else
        printf "Please call mipstoc using this format and make sure you're at the repo root:";
        printf "\nmipstoc \033[0;31marg1 - the nonmatching asm file\033[0m \033[0;34marg2 - the target function\033[0m \033[0;33margN - any of the optional mips_to_c.py flags\033[0m";
        printf "\nmipstoc \033[0;31m./asm/nonmatchings/code_13870_len_6980/func_8003B3D0.s\033[0m \033[0;34mfunc_8003B3D0\033[0m \033[0;33m--flag1 --flag2 --flagN\033[0m\n";
        /path/to/mips_to_c/mips_to_c.py;
    fi
}
export -f mipstoc

Open up the relevant .c file and replace the function's INCLUDE_ASM macro with the output from mips_to_c. Run the following command to attempt to compile, replacing function_name with the name of the function you're working with:

./diff.py -mwo function_name

Fix any errors and rerun diff.py. This will involve typing the function signature correctly, which you will probably find in Star Rod's library database. See also common_structs.h.

Once a successful build is made, diff.py will show you the difference between the original game's assembly (on the left) and what your C code generated (on the right).

Matching the function

You're on your own now. Get your C code compiling to match the original assembly! diff.py, when running, will automatically recompile your code whenever you save the .c file.

If you use Visual Studio Code, you can use Run Test Task to run diff.py and show you errors and warnings from the compiler inline. You might want to attach Run Test Task to a keybinding, as you'll be using it often.

After matching

Once you've matched a function, run the following scripts:

$ ./coverage.py --delete-matched
$ ./format.sh

If format.sh has any problems with your code, go and fix the issues. If you can't fix a warning without making the function not match anymore, append // NOLINT to the offending line.

FAQ

  • If you received the following error when running make:
sha1sum -c checksum.sha1
sha1sum: 'papermario.z64'$'\r': No such file or directory
: FAILED open or read
sha1sum: WARNING: 1 listed file could not be read
Makefile:118: recipe for target 'verify' failed
make: *** [verify] Error 1

💡 Solution

This is a Windows line ending issue run git checkout checksum.sha1 to fix it.