After changing the engine to 5.2 Rider immediately found the project files and synced the project. Now, with that part out of the way, the next step was to clean up my project folders and then attempt another build.

Final MyProject.uproject File

{
    "FileVersion": 3,
    "EngineAssociation": "5.2",
    "Category": "",
    "Description": "",
    "Modules": [
        {
            "Name": "MyProject",
            "Type": "Runtime",
            "LoadingPhase": "Default",
            "AdditionalDependencies": [
                "Engine"
            ]
        }
    ],
    "Plugins": [
        {
            "Name": "ModelingToolsEditorMode",
            "Enabled": true,
            "TargetAllowList": [
                "Editor"
            ]
        }
    ]
}

I wanted the project to be as fresh as possible so I entered the project's folder directory and deleted all the temporary folders created by the engine. From my understanding there's only a select few folders/files that are critical to building the project. These core files are the ones typically shared via version control and the rest are generated per machine thus making them safe to delete.

Troubleshooting Posts

Fix Missing Rider Plugin Modules Error When Updating an Unreal Project to a Later Version