Many systems analysis and design (SA/D) methods have been proposed over the years, each hailed by proponents as a panacea for improving productivity and quality in the SA/D process and product. There has been significant interest in evaluating such techniques based on their modeling power (e.g., Fowler 1992; Olle, Sol and Tully 1983). However, surprisingly little rigorous expetimental research has been conducted to evaluate the available tools alid techniques. One possible explanation of the lack of attention by IS researchers to this area is the inherent difficulty in conducting experiments on SA/D methods. The panel will (1) argue for the importance of experimental research to evaluate SAA) methods/techniques; (2) examine the cha#enges in conducting experiments iti this area; and (3) present strategies adopted by each of the panelists in addressing these challenges.
