Fresh development

Service Companies all over the world struggle to execute projects which require fresh development or something which needs to be done from scratch. It surprises me that this is common to industry majors to startups. What are major factors which contribute to this.
1. Estimates - This plays huge role in this and no wonder the different methodologies which one can claim, one never get this right and one keeps going back to this as a blame game during the mid way of the project to find fault in
2. Solution - I believe most of the projects struggle due to not getting the solution and approach right and believe that all new aspects pertaining to agile way of working can address this. If sufficient time is not given for this and not thought through all pros and cons, one can keep reworking through the lifecycle of the project
3. Big picture - Most of the companies and team forget the big picture of the project and end up doing things which address short term goals and end of burning time and resources late in the project life cycle
4. Resources - having right resources at right time and having the core team involved in the entire duration of the project is key for the success of the fresh development project
5. model - what model the project is getting executed is key to it success, fixed bid or time and material. There is nothing right or wrong, but my personal opinion is to execute a fresh development in fixed bid is tough for services company