It's the pith/veins, mostly.
https://www.thekitchn.com/the-true-source-of-a-chile-peppers-heat-kitchen-facts-216983 https://pepperscale.com/eating-pepper-seeds/