I have RA and have had good results using topical CBD cream to reduce inflammation and pain in my knees. I only use this for 1-2 days following a hike; these typically involve a lot of elevation gain and loss in rocky terrain.
Not sure about specific exercises beyond relaying what a nurse at the arthritis clinic told me last autumn, which was to strengthen my quadriceps. I suspect you’re already doing that, however!