Requires the library mod Collective.
Rain Be Gone Ritual is a mod which was created to give players in survival a (somewhat) logical way to stop the rain. All you need is some cauldrons, a log and a flint & steel. Place the cauldrons (minimum 4, maximum 8) around the log and set the log on fire. After the ritual there will be a harmless explosion effect, the cauldrons will be filled with water and the rain will stop. See the gif below for the effect.
A GIF showing the effect:
All of the following multi-block structures will work.
You need a minimum of 4 cauldrons, empty or filled doesn’t matter, around the log: