I think the first question you need to answer is: Do you want to follow a structured training plan?
At the moment, it seems like your priorities are more recreational (going when conditions are good, etc). In a structured training plan, you may have to make frequent choices in favor of training over something more recreation-specific. In the long-term, structured training will have greater benefits, but there’s a recreational cost in the short-term.
Have you read Scott & Steve’s book, Training for the New Alpinism? In the book are two training templates, one for general mountaineering and one for technical alpine climbing. It sounds like the latter option would work for you.