A farmer's market sells only baskets of apples and baskets of oranges, each for a fixed whole number of dollars. Abigail paid $23 for five baskets of fruit. Benedict paid $24 for four baskets of fruit. If Charles paid $20, how many baskets of fruit did he buy?