You can have the best of both worlds - flowers and veg. Whether it's a designated perennial bed blooming every year in profusion, or annuals tucked in between your veggies, you will benefit.
You will enjoy the beauty and the pollinators will approve and show you an increase in yields.
My mother always had flowers. They were her first love in the garden, followed closely by homegrown tomatoes. Enjoy!