The improvements in features are down to much more and greater quality information, and unique "publish-instruction" methods. The Main architecture with the designs remains the same, as evidenced by "open weights" models like the largest Llama types, close to SOTA, which can be run by way of the open source https://actonq011xtn6.eedblog.com/profile