Correst
A downloadable game for Windows
If you are interested in this project, the research paper can be found here:
https://docs.google.com/document/d/1-niZXkwcgNgtpviwokYuK3WOfayPpk55wnwlTvyHRT8/...
The project video (presented at NYU Gallatin Student Research Conference) can be found here:
https://stream.nyu.edu/media/Creative%20Neural%20Networks%3A%20Generating%20Live...
Abstract:
Neural networks are incredibly powerful tools that can be used to solve a multitude of problems. However, these problems are often ones with a correct answer, like image recognition and natural language processing. They are not as often used for creative generation, where there is no correct answer other than the composers' own judgements. This project pushes against this trend by using neural networks to generate live soundtracks for a video game as a user plays it, and continually retrains the network as the user makes more choices. Unity is used to build the video game and collect user input, which is then sent into neural network built in Pure Data, which also then generates and outputs the live soundtrack. This system can create a large variety of cohesive yet unique compositions to enhance the gameplay experience. This will hopefully represent a first step in a future with fully customized gameplay experiences, both artistically and methodologically.
Thank you! Feel free to reach out with any questions or issues you have.
Email: erw364@nyu.edu
Download
Install instructions
PLEASE READ INSTRUCTIONS BEFORE PLAYING
The live soundtrack is generated through Pure Data. The Pure Data patch MUST be open while the game is played or the game will not run correctly. Follow these steps:
Windows Instructions
0. If you do not have Pure Data, it can be downloaded here: https://puredata.info/downloads/pure-data
1. Download zip file and move the unzipped contents onto your computer
2. Find the "patches" folder inside the "Final_Build" folder and double click on "connected.pd"
3. In Pure Data: click "Media" in the top left navigation bar and click "DSP On" (otherwise there will be no sound)
4. Double click "DASR.exe" in the main folder ("Final_Build")
5. Play and enjoy! I would recommend starting with the tutorial if you have not played this game before
Mac Instructions
(Macs are more finicky with files, so if you are having trouble I have included some troubleshooting notes**)
0. If you do not have Pure Data, it can be downloaded here: https://puredata.info/downloads/pure-data
**If your computer says it cannot be opened because the developer cannot be identified, go to Security and Preferences --> General and at the bottom click "Open Anyway"**
1. Download zip file and move the unzipped contents onto your computer
2. Find the "patches" folder inside the "Final_Build" folder and double click on "connected.pd"
3. In Pure Data: click "Media" in the top left navigation bar and click "DSP On" (otherwise there will be no sound)
**If there is still no sound, try going to "Media" in the top left again, and click "Test Audio & Midi". This should turn the sound on.**
4. Double click "Final_Build.app" in the main folder ("Correst-Mac")
**If your computer says it cannot be opened because the developer cannot be identified, go to Security and Preferences --> General and at the bottom click "Open Anyway"**
5. Play and enjoy! I would recommend starting with the tutorial if you have not played this game before
Leave a comment
Log in with itch.io to leave a comment.