When Chase and Jo's lease is up, Chase admits she's not ready to be in a committed relationship. But making a clean break isn't easy