可以换，没什么区别。即：

Festivals and celebrations of all kinds have been held everywhere since ancient times.

All kinds of festivals and celebrations have been held everywhere since ancient times.

类似地：

He likes to read all kinds of books. 他喜欢读各种书。

He likes to read books of all kinds. 他喜欢读各种书。

This shop sells garments of all kinds. 这家商店售卖各种服装。

This shop sells all kinds of garments. 这家商店售卖各种服装。

再如：

This kind of computer is of good quality. 这种电脑质量很好。

Computers of this kind are of good quality. 这种电脑质量很好。

Many kinds of snakes are found in Africa. 非洲有很多种蛇。

Snakes of many kinds are found in Africa. 非洲有很多种蛇。