I would use the pattern size, because the finished size is also including the design ease. So if garment is designed to be a loose fitting in the waist, you want to have this same design feature even if you have to make alterations. Hope this helps 🙂
the_professors_assistant
