This paper evaluates the influence of forecast horizon and observation fit on the robustness and performance of a specific freight rate forecast model used in the liner shipping industry. In the first stage of the research, a forecast model used to predict container freight rate development is presented by exploring the relationship between individual company’s rates and aggregated market rates, and thus assists in dealing with uncertainty and market volatility for a given business situation. In the second stage, a design of experiment approach is applied to highlight the influence of the forecast horizon and observation fit and their interactions on the forecast model’s performance. The results underline the complicated nature of creating a suitable forecast model by balancing business needs, a desire to fit a good model and achieve high accuracy. There is strong empirical evidence from this study; that a robust model is preferable, that overfitting is a true danger, and that a balance must be achieved between forecast horizon and the number of observations used to fit the model. In addition, methodological guidance has also been provided on how to test, design, and choose the superior model for business needs.