多模态工业异常检测Benchmark | Ziuch の Blog

type

status

date

slug

summary

tags

category

icon

password

Last edited time

Sep 10, 2024 11:03 AM

😀

盘点各顶会在MVtec 3D-AD和Eyecandies数据集的表现

3D异常检测数据集 | Ziuch の Blog

MVtec 3D-AD，Eyecandies，Real3D-AD，Anomaly-ShapeNet

3D异常检测数据集 | Ziuch の Blog

https://ziuch.com/article/3D-Anomaly-Detection-Datasets

3D异常检测数据集 | Ziuch の Blog

方法	发表会议/期刊	Github	方法
BTF	CVPRW2023		3D特征用FPFH提取后拼接上RGB特征使用PatchCore异常检测
AST	WACV2023		师生差异进行异常检测
M3DM	CVPR2023		Transform提取特征，融合后构建三个内存库
Shape-Guided	ICML2023		3D和2D分别构建内存库
EasyNet	MM2023		在原数据上加噪声，重构成正常
CPMF	Arxiv(PR under review)		将3D转换成多视角的RGB后用PatchCore
CMF	CVPR2024		学习两种模态的相互映射，通过差异进行异常检测
MMRD	AAAI2024	ㅤ	ㅤ

notion image

notion image

📝 主旨内容

Mvtec 3D-AD

仅RGB

I-AUROC	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
PatchCore	0.876	0.880	0.791	0.682	0.912	0.701	0.695	0.618	0.841	0.702	0.770
CS-Flow	0.941	0.930	0.827	0.795	0.990	0.886	0.731	0.471	0.986	0.745	0.830
M3DM	0.944	0.918	0.896	0.749	0.959	0.767	0.919	0.648	0.938	0.767	0.850
AST	0.947	0.928	0.851	0.825	0.981	0.951	0.895	0.613	0.992	0.821	0.880
EasyNet	0.982	0.992	0.917	0.953	0.919	0.923	0.840	0.785	0.986	0.742	0.904
Shape-Guided	0.911	0.936	0.883	0.662	0.974	0.772	0.785	0.641	0.884	0.706	0.815

P-AUROC	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
PatchCore	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CS-Flow	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
AST	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
Shape-Guided	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

AUPRO	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
PatchCore	0.901	0.949	0.928	0.877	0.892	0.563	0.904	0.932	0.908	0.906	0.876
CS-Flow	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
AST	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	0.944	0.918	0.896	0.749	0.959	0.767	0.919	0.648	0.938	0.767	0.850
EasyNet	0.751	0.825	0.916	0.599	0.698	0.699	0.917	0.827	0.887	0.636	0.776
Shape-Guided	0.946	0.972	0.960	0.914	0.958	0.776	0.937	0.949	0.956	0.957	0.933

仅3D

I-AUROC	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
BTF	0.825	0.551	0.952	0.797	0.883	0.582	0.758	0.889	0.929	0.653	0.782
AST	0.881	0.576	0.965	0.957	0.679	0.797	0.990	0.915	0.956	0.611	0.833
M3DM	0.941	0.651	0.965	0.969	0.905	0.760	0.880	0.974	0.926	0.765	0.874
EasyNet	0.735	0.678	0.747	0.864	0.719	0.716	0.713	0.725	0.885	0.687	0.747
Shape-Guided	0.983	0.682	0.978	0.998	0.960	0.737	0.993	0.979	0.966	0.871	0.916
CPMF	0.983	0.889	0.989	0.991	0.958	0.809	0.988	0.959	0.979	0.969	0.952

P-AUROC	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
BTF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
AST	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
Shape-Guided	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CPMF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

AUPRO	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
BTF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
AST	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	0.943	0.818	0.977	0.882	0.881	0.743	0.958	0.974	0.950	0.929	0.906
EasyNet	0.160	0.030	0.680	0.759	0.758	0.069	0.225	0.734	0.797	0.509	0.472
Shape-Guided	0.974	0.871	0.981	0.924	0.898	0.773	0.978	0.983	0.955	0.969	0.931
CPMF	0.958	0.946	0.979	0.868	0.897	0.746	0.980	0.981	0.961	0.977	0.929

多模态

I-AUROC	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
BTF	0.918	0.748	0.967	0.883	0.932	0.582	0.896	0.912	0.921	0.886	0.865
AST	0.983	0.873	0.976	0.971	0.932	0.885	0.974	0.981	1.000	0.797	0.937
M3DM	0.994	0.909	0.972	0.976	0.960	0.942	0.973	0.899	0.972	0.850	0.945
EasyNet	0.991	0.998	0.918	0.968	0.945	0.945	0.905	0.807	0.994	0.793	0.926
Shape-Guided	0.986	0.894	0.983	0.991	0.976	0.857	0.990	0.965	0.960	0.869	0.947
CPMF	0.983	0.889	0.989	0.991	0.958	0.809	0.988	0.959	0.979	0.969	0.952
CFM	0.994	0.888	0.984	0.993	0.980	0.888	0.941	0.943	0.980	0.953	0.954

P-AUROC	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
BTF	0.996	0.993	0.997	0.985	0.985	0.984	0.996	0.994	0.997	0.996	0.992
AST	-	-	-	-	-	-	-	-	-	-	0.976
M3DM	0.995	0.993	0.997	0.985	0.985	0.984	0.996	0.994	0.997	0.996	0.992
EasyNet	0.378	0.939	0.448	0.161	0.115	0.674	0.308	0.930	0.223	0.304	ㅤ
Shape-Guided	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CPMF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CFM	0.997	0.992	0.999	0.972	0.987	0.993	0.998	0.999	0.998	0.998	0.993

AUPRO	Bagel	Cable Gland	Carrot	Cookie	Dowel	Foam	Peach	Potato	Rope	Tire	Mean
BTF	0.976	0.969	0.979	0.973	0.933	0.888	0.975	0.981	0.950	0.971	0.959
AST	0.970	0.947	0.981	0.939	0.913	0.906	0.979	0.982	0.889	0.940	0.944
M3DM	0.970	0.971	0.979	0.950	0.941	0.932	0.977	0.971	0.971	0.975	0.964
EasyNet	0.839	0.864	0.951	0.618	0.828	0.836	0.942	0.889	0.911	0.528	0.821
Shape-Guided	0.981	0.973	0.982	0.971	0.962	0.978	0.981	0.983	0.974	0.975	0.976
CPMF	0.958	0.946	0.979	0.868	0.897	0.746	0.980	0.981	0.961	0.977	0.929
CFM	0.979	0.972	0.982	0.945	0.950	0.968	0.980	0.982	0.975	0.981	0.971

Eyecandies

仅RGB

I-AUROC	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	0.723	0.925	0.849	0.966	0.705	0.815	0.806	0.851	0.975	0.960	0.858
CFM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

P-AUROC	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CFM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

AUPRO	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CFM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

仅3D

I-AUROC	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
BTF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	0.629	0.716	0.768	0.731	0.660	0.710	0.712	0.711	0.688	0.731	0.706
CFM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

P-AUROC	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
BTF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CFM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

AUPRO	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
BTF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CFM	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ

多模态

I-AUROC	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
BTF	0.606	0.904	0.792	0.939	0.720	0.563	0.867	0.860	0.992	0.842	0.809
AST	0.574	0.747	0.747	0.889	0.596	0.617	0.816	0.841	0.987	0.987	0.780
M3DM	0.624	0.958	0.958	1.000	0.886	0.758	0.949	0.836	1.000	1.000	0.897
M3DM*	0.597	0.954	0.931	0.990	0.883	0.666	0.923	0.888	0.995	1.000	0.882
EasyNet	0.737	0.934	0.866	0.966	0.717	0.822	0.847	0.863	0.977	0.960	0.869
CFM	0.680	0.931	0.952	0.880	0.865	0.782	0.917	0.840	0.998	0.962	0.881

P-AUROC	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
BTF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	0.974	0.987	0.962	0.998	0.966	0.941	0.973	0.984	0.996	0.985	0.977
M3DM*	0.968	0.986	0.964	0.998	0.976	0.928	0.976	0.988	0.996	0.995	0.977
AST	0.763	0.960	0.911	0.969	0.788	0.837	0.918	0.924	0.983	0.968	0.902
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CFM	0.983	0.982	0.964	0.989	0.949	0.946	0.969	0.980	0.995	0.987	0.974

AUPRO	CandyCane	ChocolateCookie	ChocolatePraline	Confetto	GummyBear	HazelnutTruffle	LicoriceSandwich	Lollipop	Marshmallow	PeppermintCandy	Mean
BTF	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
M3DM	0.906	0.923	0.803	0.983	0.855	0.688	0.880	0.906	0.966	0.955	0.882
M3DM*	0.889	0.921	0.808	0.982	0.889	0.675	0.872	0.901	0.964	0.973	0.887
AST	0.514	0.835	0.714	0.905	0.587	0.590	0.736	0.769	0.918	0.878	0.744
EasyNet	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ	ㅤ
CFM	0.942	0.902	0.831	0.965	0.875	0.762	0.791	0.913	0.939	0.949	0.887

🤗 总结归纳

Mvtec 3DAD柱状图代码

Eyecandies柱状图代码

📎 参考文章

作者:ziuch
链接:https://ziuch.com/article/Multimodal-Industrial-Anomaly-Detection-Benchmark
声明:本文采用 CC BY-NC-SA 4.0 许可协议，转载请注明出处。

相关文章

科研全流程加速——让AI为你插上翅膀

PatchCore内存库中核心集的选择

Transformer中的位置编码

2024年异常检测顶会汇总

AnomalyDiffusion(AAAI2024)

Control Net：控制增强的微调方法

自建OverLeaf——妈妈再也不用担心我的论文编译超时 CFM中2D到3D相似度低解决方案

Loading...