I want to keep some dice and reroll the rest

Please use Lock mode. Select Lock under "Roll Style" in the settings, then lock the dice you want to keep. Those dice will stay as they are, and only the unlocked dice will be rerolled.

This is handy for play styles where you keep certain results and reroll the others (like Yahtzee).