In earlier V-Ray versions, the V-Ray Material Library is called Preset Material Library and it resides in the Asset Browser. The Browse Materials in Cosmos button in the left panel of the V-Ray Asset Editor opens the material library. In V-Ray 6, the V-Ray Material Library is part of the Chaos Cosmos Browser.
