I suspect that peppers like a long hot season to develop their full flavor. Do you plant the
seed outdoors? Maybe if you can start them early, indoors, with light and heat, so that they go outside when the weather is warm and they are already big, that might do it? Or if you have a
greenhouse or cold frame, try leaving some pepper plants in there all summer? I don't really know.