Nonlinear filtering is an effective noise restraining technology and has been widely used. In order to solve the problem that the speed of classical median filter was slow because of a lot of sorting, in this paper, the method of the C code optimization based on the TMS320C6000 Series DSP is used to optimize the code of median filter. Compares with the original code, the optimized code reduces the running time, enhancing the performance of code execution. In addition, it will meet the requirement of real-time image processing.