Joshua is a product of the club's academy programme and was offered a professional contract at the end of the 2023/24 season having completed his two-year scholarship.
Bayliss can play on either wing or through the middle in an attacking position and scored the opening goal in Gills 2-1 win over Ware FC in the first round of the FA Youth Cup in 2023.