Commit e13f1f29 by Klin

feat: Robust Fit

parent 74043eb6
...@@ -119,7 +119,7 @@ ...@@ -119,7 +119,7 @@
**cifar10数据集** **cifar10数据集**
<img src="fig/ALL-cifar10-ptq.png" alt="ALL-cifar10-ptq" style="zoom:67%;" /> <img src="./fig/ALL-cifar10-ptq.png" alt="ALL-cifar10-ptq" style="zoom:67%;" />
​ 单个模型及js_flops - acc_loss拟合对应R2: ​ 单个模型及js_flops - acc_loss拟合对应R2:
...@@ -133,7 +133,7 @@ ...@@ -133,7 +133,7 @@
**cifar100数据集** **cifar100数据集**
<img src="fig/ALL-cifar100-ptq.png" alt="ALL-cifar100-ptq" style="zoom:67%;" /> <img src="./fig/ALL-cifar100-ptq.png" alt="ALL-cifar100-ptq" style="zoom:67%;" />
​ 单个模型及js_flops - acc_loss拟合对应R2: ​ 单个模型及js_flops - acc_loss拟合对应R2:
...@@ -171,7 +171,7 @@ ...@@ -171,7 +171,7 @@
+ 添加对抗样本可以提升伪数据集鲁棒性(增加模型唉伪数据集上对抗精度) + 添加对抗样本可以提升伪数据集鲁棒性(增加模型唉伪数据集上对抗精度)
4. 基于伪数据集评估全精度模型和量化模型的对抗精度,预测其鲁棒性 4. 基于伪数据集评估全精度模型和量化模型的对抗精度,预测其鲁棒性
+ 额外的思路:(待测试)利用量化模型层中统计的每层in和out,可得到模型lipschitz,得到理论上的鲁棒性上界。 + 额外的思路:(待测试)利用量化模型层中统计的每层in和out,将各层扰动前后的输出差/输入差相乘可得到模型lipschitz,得到理论上的鲁棒性上界。
+ 新模型迁移前后鲁棒性预测方式: + 新模型迁移前后鲁棒性预测方式:
...@@ -196,27 +196,28 @@ ...@@ -196,27 +196,28 @@
2. 需要根据cfg更改模型结构为实验所设,并导入预训练模型的参数,得到全精度网络 2. 需要根据cfg更改模型结构为实验所设,并导入预训练模型的参数,得到全精度网络
3. 根据鲁棒性部分实验思路,可以训练得到生成器,得到伪数据集 3. 根据鲁棒性部分实验思路,可以训练得到生成器,得到伪数据集
3. 根据伪数据集的前向传播获取各层统计,得到量化网络 4. 根据伪数据集的前向传播获取各层统计,得到量化网络
4. 根据全精度网络和量化网络参数相似度预测迁移精度损失(同准确性部分) 5. 根据全精度网络和量化网络参数相似度预测迁移精度损失(同准确性部分)
5. 根据全精度网络和量化网络在伪数据集上表现预测安全性。 6. 根据全精度网络和量化网络在伪数据集上表现预测安全性。
### 生成器训练 ### 生成器训练
+ slurm命令 + slurm命令
> 此处multi_label_prob表明了边界样本占生成伪数据的比例
```shell ```shell
python gen_one.py --model $Model --dataset $Dataset --multi_label_prob 0.4 --multi_label_num $Label # 仅训练
python gen_one.py --model $Model --dataset $Dataset --multi_label_num $Label
# 训练后根据模型在测试集上对抗性得分进行调整
python gen_one.py --model $Model --dataset $Dataset --multi_label_num $Label --adjust
``` ```
在ALL目录下运行脚本 在ALL目录下运行脚本
```shell ```shell
# 切换数据集需将脚本名字中{cifar10}改为{cifar100} # 切换数据集需将脚本名字中{cifar10}改为{cifar100}
#针对单个模型训练生成器 #针对单个模型训练和调整生成器
sh scripts/gen_one_cifar10.sh AlexNet/... sh scripts/gen_one_cifar10.sh AlexNet/...
#针对全部模型训练生成器 #针对全部模型训练和调整生成器
sh scripts/gen_all_cifar10.sh sh scripts/gen_all_cifar10.sh
``` ```
...@@ -225,33 +226,102 @@ ...@@ -225,33 +226,102 @@
+ 训练时以输入生成器的label为基准,关注生成器生成的伪数据经过模型分类的结果与label的符合程度 + 训练时以输入生成器的label为基准,关注生成器生成的伪数据经过模型分类的结果与label的符合程度
+ 调整时以全精度模型在测试集上的精度和对抗下精度为指导,通过添加类间样本和对抗样本调整伪数据集的鲁棒性和泛化性 + 调整时以全精度模型在测试集上的精度和对抗下精度为指导,通过添加类间样本和对抗样本调整伪数据集的鲁棒性和泛化性
### 数据分布可视化 ### 数据分布可视化
> 以cifar10数据集下的ResNet_18模型为例,可视化原测试集/仅训练的伪数据集/调整后的伪数据集的数据分布可视图 > 以cifar10数据集下的ResNet_18模型为例,可视化原测试集/仅训练的伪数据集/调整后的伪数据集的数据分布可视图
分别以测试集/伪数据集的data经过模型提取特征,根据PCA降维获取分布。label决定了样本分类颜色。
<table>
<tr>
<td><center><img src="./fig/pca_src.png"></im</center></td>
<td><center><img src="./fig/pca_gen_org.png"></im</center></td>
<td><center><img src="./fig/pca_gen_adjust.png"></im</center></td>
</tr>
</table>
+ 测试集的数据分布较为集聚,部分类间距离较大,无法覆盖整个输入特征空间
+ 仅训练的生成器所得伪数据较好的模拟了测试集的数据分布,但是进一步增大了类间距离,忽略了聚类边缘的样本。样本虽然分类精度高,但鲁棒性较差。
+ 通过调整,生长器的伪数据能保持较高的分类精度(高于测试集)和鲁棒性(对抗下精度与测试集误差不超过1%),且能够较好的覆盖特征空间,其评测结果对于一般输入样本更具泛化性
### 对抗攻击可视化 ### 对抗攻击可视化
+ 展示各种对抗攻击下图片扰动结果,本实验采取的攻击强度均为人眼不可识别 + 展示对抗攻击下图片扰动结果,本实验采取的攻击强度均为人眼不可识别
+ 后续将添加具体图片展示及图片扰动的L2距离 + 展示了测试集样本扰动前后的图像(下载后经过修改尺寸)
<table>
<tr>
<td><center><img src="./fig/img_org.png"></im</center></td>
<td><center><img src="./fig/img_adv.png"></im</center></td>
</tr>
</table>
### 模型鲁棒性评估 ### 模型鲁棒性评估
+ slurm命令
```shell
python robust_one.py --model $Model --dataset $Dataset --multi_label_num $Label $Adjust
```
在ALL目录下运行脚本
```shell
# 切换数据集需将脚本名字中{cifar10}改为{cifar100}
# $Adjust置为“--adjust”表示评估调整后的生成器,空则为无调整生成器
#针对单个模型评估鲁棒性
sh scripts/robust_one_cifar10.sh AlexNet/...
#针对全部模型评估鲁棒性
sh scripts/robust_all_cifar10.sh
```
+ 鲁棒性评估结果详见robust_result/{Dataset}/{Model}{Adjust}.txt
+ 优势: + 优势:
+ 从结果而言,从针对全精度模型生成的伪数据集上攻击结果预测真实测试集上攻击结果,指标更直观; + 从结果而言,从针对全精度模型生成的伪数据集上攻击结果预测真实测试集上攻击结果,指标更直观;
+ 从过程而言,针对全精度生成的伪数据集可以隐式表明模型特征,省略显式拟合的复杂 + 从过程而言,针对全精度生成的伪数据集可以隐式表明模型特征,省略显式拟合的复杂
+ 生成器的解映射使用了模型最后全连接层的权重 + 生成器的解映射使用了模型最后全连接层的权重
+ 训练过程loss考虑了模型分类结果和BN层分布信息 + 训练过程loss考虑了模型分类结果和BN层分布信息
+ 生成器调整技巧: + 生成器调整技巧:
+ 训练过程中如果只生成类内样本,伪数据集在对抗攻击下仍能取得较高精度
+ 混入一定比例的类间样本可以降低对抗攻击下精度,使得生成数据类间距离变小,更符合真实数据集分布
+ 结果:
+ 趋势相同,在多种攻击下,大部分量化模型的精度偏差均不超过5个点
+ 可视化图像待补充
+ 训练过程中如果使用类内无对抗样本,伪数据集虽然分类精度高(接近100),但对抗下欠鲁棒
+ 调整阶段
+ 添加类间样本(多label)可以增强伪数据集泛化性,更好的覆盖特征空间空白部分
+ 添加类内对抗样本(类内样本加对抗扰动)可以增强伪数据集鲁棒性,使在保持一定无对抗分类精度(高于测试集)的同时取得更高的对抗下精度
+ 拟合结果:
左图:无对抗下伪数据集相对精度 - 测试集相对精度
右图:pgd对抗下伪数据集相对精度 - 测试集相对精度
**cifar10**
<table>
<tr>
<td><center><img src="./fig/cifar10_org.png"></im</center></td>
<td><center><img src="./fig/cifar10_pgd.png"></im</center></td>
</tr>
</table>
**cifar100**
<table>
<tr>
<td><center><img src="./fig/cifar100_org.png"></im</center></td>
<td><center><img src="./fig/cifar100_pgd.png"></im</center></td>
</tr>
</table>
+ cifar10和cifar100数据集下都能很好的反映无对抗情境下的分类精度
+ 添加对抗后,cifar10拟合效果尚可,而cifar100效果较差
+ 考虑到采用的对抗攻击是将样本错误分类而不需指定错误分类类别,cifar100更容易达成攻击,因此直接使用评分指导可能存在误差
+ 优化尝试方向:
考虑成比例的添加对抗样本和类间样本,并使用相对精度以排除绝对值影响,希望提高拟合效果并完全排除原数据集(当前需要给出模型在测试集上有无对抗时的精度作为adjust的指导)
"""
利用PCA降维可视化伪数据所得特征与模型分类结果/生成器输入标签关系,从而观测决策边界
模型分类结果out表示该模型的决策边界
生成器输入标签label表示生成器所拟合的边界
针对cifar10数据集下ResNet_18生成可视化图像
"""
from model import Model
from dataloader import DataLoader
import os
import argparse
import numpy as np
import pandas as pd
from scipy.linalg import eigh
import torch
import torch.nn as nn
import torchvision
from torchvision import datasets, transforms
import seaborn as sns
from matplotlib import pyplot as plt
from sklearn.preprocessing import StandardScaler
from sklearn.decomposition import PCA
parser = argparse.ArgumentParser(description='PCA features')
# 获取测试集在model上分类图
parser.add_argument('--pca_src', action='store_true')
# 生成器伪数据的分类图,不含类间样本
parser.add_argument('--pca_gen', action='store_true')
# 生成器伪数据的分类图,包含类间样本
parser.add_argument('--pca_mix', action='store_true')
# 两两类之间的决策边界路径
parser.add_argument('--pca_path', action='store_true')
# 路径参数设置
parser.add_argument('--num_dot_per_mix', type=int, default=200)
parser.add_argument('--num_dot_per_path', type=int, default=200)
# 指定选择哪个模型对应的生成器
parser.add_argument('--quant',action='store_true')
# 当选择的为量化网络时,下述参数才生效
parser.add_argument('--quant_type',type=str,default='NONE')
parser.add_argument('--num_bits',type=int,default=0)
parser.add_argument('--e_bits',type=int,default=0)
def reduce_df(dataframe, num_per_class):
df_list = []
for i in range(10):
df_list.append(dataframe.iloc[i * 5000: i * 5000 + num_per_class])
df = pd.concat(df_list)
return df
if __name__ == '__main__':
args = parser.parse_args()
# 确定模型及生成器路径
if args.quant:
if args.quant_type == 'FLOAT':
title = '%s_%d_E%d' % (args.quant_type, args.num_bits, args.e_bits)
else:
title = '%s_%d' % (args.quant_type, args.num_bits)
model_file = 'ckpt_quant/cifar10/ResNet_18/'+title+'.pt'
gen_file = 'ckpt_quant_gen/cifar10/ResNet_18/'+title+'.pt'
pca_dir = 'pca_ResNet18_cifar10/'+title+'/'
else:
model_file = 'ckpt_full/cifar10/ResNet_18.pt'
gen_file = 'ckpt_full_gen/cifar10/ResNet_18.pt'
pca_dir = 'pca_ResNet18_cifar10/FULL/'
if True in [args.pca_gen, args.pca_mix, args.pca_path]:
generator = torch.load(gen_file)
generator.eval()
if True in [args.pca_src, args.pca_gen, args.pca_mix, args.pca_path]:
os.makedirs(pca_dir, exist_ok=True)
model = Model(model_name='ResNet_18',dataset='cifar10').cuda()
if args.quant:
model.quantize(args.quant_type,args.num_bits,args.e_bits)
model.load_state_dict(torch.load(model_file))
model.eval()
print('Model Ready')
dataloader = DataLoader('cifar10',512)
_,_,test_loader = dataloader.getloader()
features = []
targets = []
with torch.no_grad():
for i, (data, target) in enumerate(test_loader):
data = data.cuda()
if args.quant:
_, feature = model.quantize_forward(data, out_feature=True)
else:
_, feature = model(data, out_feature=True)
features.append(feature.cpu())
targets.append(target)
features_cat = torch.cat(features, dim=0)
targets_cat = torch.cat(targets, dim=0)
feature_scaler = StandardScaler().fit(features_cat)
standardized_data = feature_scaler.transform(features_cat)
covar_matrix = np.matmul(standardized_data.T , standardized_data)
values, vectors = eigh(covar_matrix, eigvals=(510,511))
vectors = vectors.T
if args.pca_src:
print('pca of source data')
new_coordinates = np.matmul(vectors, standardized_data.T)
new_coordinates = np.vstack((new_coordinates, targets_cat)).T
dataframe = pd.DataFrame(data=new_coordinates, columns=("1st_principal", "2nd_principal", "label"))
dataframe.sort_values(by=['label'], axis=0, inplace=True)
df = reduce_df(dataframe, 1000)
pca_result = sns.FacetGrid(df, hue="label", height=10, hue_kws={'marker':['x'] * 10}).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_dir+'pca_src.png')
if args.pca_gen or args.pca_mix or args.pca_path:
print('pca of gen')
features_gen = []
targets_label = []
targets_out = []
with torch.no_grad():
for i in range(50):
z = torch.randn(200, 512).cuda()
labels = (torch.ones(200) * (i // 5)).type(torch.LongTensor)
targets_label.append(labels)
labels = labels.cuda()
z = z.contiguous()
labels = labels.contiguous()
images = generator(z, labels)
if args.quant:
out, feature = model.quantize_forward(images, out_feature=True)
else:
out, feature = model(images, out_feature=True)
features_gen.append(feature.cpu())
pred = out.argmax(dim=1, keepdim=True)
pred = pred.view_as(labels)
targets_out.append(pred.cpu())
features_cat_gen = torch.cat(features_gen, dim=0)
targets_cat_label = torch.cat(targets_label, dim=0)
targets_cat_out = torch.cat(targets_out, dim=0)
standardized_data_gen = feature_scaler.transform(features_cat_gen)
new_coordinates_gen = np.matmul(vectors, standardized_data_gen.T)
new_coordinates_label = np.vstack((new_coordinates_gen, targets_cat_label)).T
new_coordinates_out = np.vstack((new_coordinates_gen, targets_cat_out)).T
dataframe_label = pd.DataFrame(data=new_coordinates_label, columns=("1st_principal", "2nd_principal", "label"))
dataframe_out = pd.DataFrame(data=new_coordinates_out, columns=("1st_principal", "2nd_principal", "label"))
if args.pca_gen:
pca_result_label = sns.FacetGrid(dataframe_label, hue="label", height=10, hue_kws={'marker':['x'] * 10}).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result_label.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_dir+'pca_gen.png')
pca_result_out = sns.FacetGrid(dataframe_out, hue="label", height=10, hue_kws={'marker':['x'] * 10}).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result_out.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_dir+'pca_model.png')
if args.pca_mix or args.pca_path:
print('pca of embedding superposing')
linear = []
for i in range(args.num_dot_per_mix):
linear.append(torch.tensor([[i / args.num_dot_per_mix, 1 - (i / args.num_dot_per_mix)]]))
linear = torch.cat(linear, dim=0)
features_gen_mix = []
targets_label_mix = []
with torch.no_grad():
for i in range(10):
for j in range(i + 1, 10):
z = torch.randn(args.num_dot_per_mix, 2, 512).cuda()
z = z.contiguous()
labels = torch.tensor([[i, j]])
labels = torch.cat([labels] * args.num_dot_per_mix, dim=0).cuda()
target = torch.cat([torch.tensor([300])] * args.num_dot_per_mix, dim=0)
targets_label_mix.append(target)
l = linear.cuda()
images = generator(z, labels, l)
if args.quant:
out, feature = model.quantize_forward(images, out_feature=True)
else:
out, feature = model(images, out_feature=True)
features_gen_mix.append(feature.cpu())
features_cat_gen_mix = torch.cat(features_gen_mix, dim=0)
targets_cat_label_mix = torch.cat(targets_label_mix, dim=0)
standardized_data_gen_mix = feature_scaler.transform(features_cat_gen_mix)
new_coordinates_gen_mix = np.matmul(vectors, standardized_data_gen_mix.T)
new_coordinates_label_mix = np.vstack((new_coordinates_gen_mix, targets_cat_label_mix)).T
dataframe_label_mix = pd.DataFrame(data=new_coordinates_label_mix, columns=("1st_principal", "2nd_principal", "label"))
if args.pca_mix:
pca_result_label_mix = sns.FacetGrid(
pd.concat([dataframe_label_mix, dataframe_label]),
hue="label",
hue_order=[300.0, 0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0] ,
height=10,
hue_kws={'marker':['x'] * 11, 'color': ['black'] + sns.color_palette("tab10")[:10]}
).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result_label_mix.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_dir+'pca_gen_mix.png')
if args.pca_path:
print('pca of path')
pca_path_dir = pca_dir+'pca_path/'
os.makedirs(pca_path_dir, exist_ok=True)
linear = []
for i in range(args.num_dot_per_path):
linear.append(torch.tensor([[i / args.num_dot_per_path, 1 - (i / args.num_dot_per_path)]]))
linear = torch.cat(linear, dim=0)
features_no_noise = []
targets_no_noise = []
with torch.no_grad():
for i in range(10):
for j in range(i + 1, 10):
z = torch.zeros(args.num_dot_per_path, 2, 512).cuda()
z = z.contiguous()
labels = torch.tensor([[i, j]])
labels = torch.cat([labels] * args.num_dot_per_path, dim=0).cuda()
target = torch.tensor([(i + 1) * 10 + j])
target = torch.cat([target] * args.num_dot_per_path, dim=0)
targets_no_noise.append(target)
l = linear.cuda()
images = generator(z, labels, l)
if args.quant:
_, feature = model.quantize_forward(images, out_feature=True)
else:
_, feature = model(images, out_feature=True)
features_no_noise.append(feature.cpu())
features_cat_no_noise = torch.cat(features_no_noise, dim=0)
targets_cat_no_noise = torch.cat(targets_no_noise, dim=0)
standardized_data_no_noise = feature_scaler.transform(features_cat_no_noise)
new_coordinates_no_noise = np.matmul(vectors, standardized_data_no_noise.T)
new_coordinates_no_noise = np.vstack((new_coordinates_no_noise, targets_cat_no_noise)).T
dataframe_no_noise = pd.DataFrame(data=new_coordinates_no_noise, columns=("1st_principal", "2nd_principal", "label"))
MID_DOT_NUM = 11
linear = []
for i in range(MID_DOT_NUM):
linear.append(torch.tensor([[i/(MID_DOT_NUM - 1), 1 - (i/(MID_DOT_NUM - 1))]]))
linear = torch.cat(linear, dim=0)
features_no_noise_ten = []
targets_no_noise_ten = []
with torch.no_grad():
for i in range(10):
for j in range(i + 1, 10):
z = torch.zeros(MID_DOT_NUM, 2, 512).cuda()
z = z.contiguous()
labels = torch.tensor([[i, j]])
labels = torch.cat([labels] * MID_DOT_NUM, dim=0).cuda()
target = torch.tensor([(i + 1) * 10 + j + 500])
target = torch.cat([target] * MID_DOT_NUM, dim=0)
targets_no_noise_ten.append(target)
l = linear.cuda()
images = generator(z, labels, l)
if args.quant:
_, feature = model.quantize_forward(images, out_feature=True)
else:
_, feature = model(images, out_feature=True)
features_no_noise_ten.append(feature.cpu())
features_cat_no_noise_ten = torch.cat(features_no_noise_ten, dim=0)
targets_cat_no_noise_ten = torch.cat(targets_no_noise_ten, dim=0)
color = sns.color_palette("tab10")
features_total = torch.cat([features_cat_gen, features_cat_no_noise, features_cat_gen_mix, features_cat_no_noise_ten], dim=0)
targets_total = torch.cat([targets_cat_label, targets_cat_no_noise, targets_cat_label_mix, targets_cat_no_noise_ten], dim=0)
no_noise_start = len(targets_cat_label)
mix_start = no_noise_start + len(targets_cat_no_noise)
no_noise_ten_start = mix_start + len(targets_cat_label_mix)
standardized_data_total = feature_scaler.transform(features_total)
x = 0
for i in range(10):
for j in range(i + 1, 10):
if j - i == 1:
selected_features = torch.cat([
features_cat_gen[i * 1000: (i + 1) * 1000],
features_cat_gen[j * 1000: (j + 1) * 1000],
features_cat_no_noise[x * args.num_dot_per_path: (x + 1) * args.num_dot_per_path],
features_cat_gen_mix[x * args.num_dot_per_mix: (x + 1) * args.num_dot_per_mix],
features_cat_no_noise_ten[x * MID_DOT_NUM: (x + 1) * MID_DOT_NUM]
] , dim=0)
selected_targets = torch.cat([
targets_cat_label[i * 1000: (i + 1) * 1000],
targets_cat_label[j * 1000: (j + 1) * 1000],
targets_cat_no_noise[x * args.num_dot_per_path: (x + 1) * args.num_dot_per_path],
targets_cat_label_mix[x * args.num_dot_per_mix: (x + 1) * args.num_dot_per_mix],
targets_cat_no_noise_ten[x * MID_DOT_NUM: (x + 1) * MID_DOT_NUM]
], dim=0)
standardized_data_selected = feature_scaler.transform(selected_features)
covar_matrix_selected = np.matmul(standardized_data_selected.T , standardized_data_selected)
values_selected, vectors_selected = eigh(covar_matrix_selected, eigvals=(510,511))
vectors_selected = vectors_selected.T
new_coordinates_selected = np.matmul(vectors_selected, standardized_data_selected.T)
new_coordinates_selected = np.vstack((new_coordinates_selected, selected_targets)).T
df_selected = pd.DataFrame(data=new_coordinates_selected, columns=("1st_principal", "2nd_principal", "label"))
pca_result_selected = sns.FacetGrid(df_selected, hue="label", height=10, hue_kws={'marker':['o', 'o', 'o', 'o', 'o'], 's':[30, 30, 30, 30, 300], 'color':[color[i], color[j], 'black', 'lightgreen', 'black'],}).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result_selected.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_path_dir + f'path_{i}_{j}.png')
x += 1
if [ -z $1 ];then
cat $(ls -1 ret/ret-*.out | sort -n -t - -k 2 | tail -n 1)
else
cat ret/ret-"$1".out
fi
\ No newline at end of file
Gen: AlexNet cifar10 Gen: AlexNet cifar10
Namespace(dataset='cifar10', freeze=False, model='AlexNet', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='AlexNet', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 88.640000 Teacher Accuray: 88.640000
Train Result: Train Result:
Gen acc: 99.824219 Gen acc: 99.917969
Time: 44.96s Time: 38.51s
Adjust Result: Adjust Result:
Iters: 13 Iters: 105
Gen acc: 98.945312 Gen acc: 95.000000
FGSM acc: 43.828125 -- 45.340000(Testloader) FGSM acc: 48.281250 -- 45.340000(Testloader)
PGD acc: 19.023438 -- 19.810000(Testloader) PGD acc: 20.351562 -- 19.840000(Testloader)
Time: 19.30s Time: 78.02s
Gen: AlexNet_BN cifar10 Gen: AlexNet_BN cifar10
Namespace(dataset='cifar10', freeze=False, model='AlexNet_BN', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='AlexNet_BN', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 90.130000 Teacher Accuray: 90.130000
Train Result: Train Result:
Gen acc: 99.878906 Gen acc: 99.972656
Time: 59.58s Time: 56.85s
Adjust Result: Adjust Result:
Iters: 3 Iters: 17
Gen acc: 97.656250 Gen acc: 91.015625
FGSM acc: 51.015625 -- 48.620000(Testloader) FGSM acc: 38.242188 -- 48.620000(Testloader)
PGD acc: 21.601562 -- 19.170000(Testloader) PGD acc: 20.039062 -- 19.170000(Testloader)
Time: 10.53s Time: 29.39s
Gen: Inception_BN cifar10 Gen: Inception_BN cifar10
Namespace(dataset='cifar10', freeze=False, model='Inception_BN', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='Inception_BN', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 94.830000 Teacher Accuray: 94.830000
Train Result: Train Result:
Gen acc: 99.976562 Gen acc: 100.000000
Time: 430.90s Time: 431.35s
Adjust Result: Adjust Result:
Iters: 1 Iters: 10
Gen acc: 94.375000 Gen acc: 94.687500
FGSM acc: 45.625000 -- 42.760000(Testloader) FGSM acc: 41.445312 -- 42.640000(Testloader)
PGD acc: 5.976562 -- 7.210000(Testloader) PGD acc: 6.835938 -- 7.220000(Testloader)
Time: 102.60s Time: 260.47s
Gen: MobileNetV2 cifar10 Gen: MobileNetV2 cifar10
Namespace(dataset='cifar10', freeze=False, model='MobileNetV2', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='MobileNetV2', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 90.270000 Teacher Accuray: 90.280000
Train Result: Train Result:
Gen acc: 99.957031 Gen acc: 99.968750
Time: 246.35s Time: 256.14s
Adjust Result: Adjust Result:
Iters: 2 Iters: 143
Gen acc: 80.976562 Gen acc: 96.406250
FGSM acc: 37.890625 -- 40.190000(Testloader) FGSM acc: 35.781250 -- 40.180000(Testloader)
PGD acc: 3.320312 -- 5.590000(Testloader) PGD acc: 6.132812 -- 5.610000(Testloader)
Time: 39.31s Time: 962.08s
Gen: ResNet_152 cifar10 Gen: ResNet_152 cifar10
Namespace(dataset='cifar10', freeze=False, model='ResNet_152', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='ResNet_152', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 94.430000 Teacher Accuray: 94.430000
Train Result: Train Result:
Gen acc: 99.558594 Gen acc: 99.980469
Time: 967.98s Time: 983.17s
Adjust Result: Adjust Result:
Iters: 5 Iters: 1
Gen acc: 89.062500 Gen acc: 99.921875
FGSM acc: 42.421875 -- 44.370000(Testloader) FGSM acc: 49.414062 -- 44.340000(Testloader)
PGD acc: 12.343750 -- 10.190000(Testloader) PGD acc: 12.500000 -- 10.240000(Testloader)
Time: 334.84s Time: 221.71s
Gen: ResNet_18 cifar10 Gen: ResNet_18 cifar10
Namespace(dataset='cifar10', freeze=False, model='ResNet_18', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='ResNet_18', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 94.300000 Teacher Accuray: 94.310000
Train Result: Train Result:
Gen acc: 99.910156 Gen acc: 99.980469
Time: 143.98s Time: 142.13s
Adjust Result: Adjust Result:
Iters: 14 Iters: 99
Gen acc: 99.609375 Gen acc: 99.257812
FGSM acc: 47.968750 -- 47.410000(Testloader) FGSM acc: 34.882812 -- 47.330000(Testloader)
PGD acc: 10.585938 -- 11.240000(Testloader) PGD acc: 12.148438 -- 11.270000(Testloader)
Time: 80.04s Time: 473.30s
Gen: ResNet_50 cifar10 Gen: ResNet_50 cifar10
Namespace(dataset='cifar10', freeze=False, model='ResNet_50', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='ResNet_50', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 94.570000 Teacher Accuray: 94.570000
Train Result: Train Result:
Gen acc: 99.964844 Gen acc: 100.000000
Time: 394.87s Time: 588.57s
Adjust Result: Adjust Result:
Iters: 18 Iters: 1
Gen acc: 97.265625 Gen acc: 97.929688
FGSM acc: 46.015625 -- 44.400000(Testloader) FGSM acc: 55.000000 -- 44.430000(Testloader)
PGD acc: 11.250000 -- 8.920000(Testloader) PGD acc: 10.234375 -- 8.910000(Testloader)
Time: 325.25s Time: 128.45s
Gen: VGG_16 cifar10 Gen: VGG_16 cifar10
Namespace(dataset='cifar10', freeze=False, model='VGG_16', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='VGG_16', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 93.130000 Teacher Accuray: 93.130000
Train Result: Train Result:
Gen acc: 99.863281 Gen acc: 99.984375
Time: 131.06s Time: 131.10s
Adjust Result: Adjust Result:
Iters: 7 Iters: 25
Gen acc: 99.726562 Gen acc: 92.031250
FGSM acc: 51.640625 -- 53.170000(Testloader) FGSM acc: 40.937500 -- 53.170000(Testloader)
PGD acc: 20.546875 -- 18.740000(Testloader) PGD acc: 19.062500 -- 18.710000(Testloader)
Time: 35.02s Time: 92.61s
Gen: VGG_19 cifar10 Gen: VGG_19 cifar10
Namespace(dataset='cifar10', freeze=False, model='VGG_19', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False) Namespace(adjust=True, dataset='cifar10', freeze=False, model='VGG_19', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result: Test Result:
Teacher Accuray: 93.030000 Teacher Accuray: 93.030000
Train Result: Train Result:
Gen acc: 99.941406 Gen acc: 99.941406
Time: 147.04s Time: 147.77s
Adjust Result: Adjust Result:
Iters: 21 Iters: 2
Gen acc: 97.343750 Gen acc: 90.625000
FGSM acc: 49.375000 -- 50.580000(Testloader) FGSM acc: 70.000000 -- 50.580000(Testloader)
PGD acc: 14.687500 -- 16.890000(Testloader) PGD acc: 17.539062 -- 16.820000(Testloader)
Time: 89.95s Time: 27.11s
Gen: AlexNet cifar10
Namespace(dataset='cifar10', freeze=False, model='AlexNet', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 88.640000
Train Result:
Gen acc: 99.824219
Time: 44.96s
Adjust Result:
Iters: 13
Gen acc: 98.945312
FGSM acc: 43.828125 -- 45.340000(Testloader)
PGD acc: 19.023438 -- 19.810000(Testloader)
Time: 19.30s
Gen: AlexNet_BN cifar10
Namespace(dataset='cifar10', freeze=False, model='AlexNet_BN', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 90.130000
Train Result:
Gen acc: 99.878906
Time: 59.58s
Adjust Result:
Iters: 3
Gen acc: 97.656250
FGSM acc: 51.015625 -- 48.620000(Testloader)
PGD acc: 21.601562 -- 19.170000(Testloader)
Time: 10.53s
Gen: Inception_BN cifar10
Namespace(dataset='cifar10', freeze=False, model='Inception_BN', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 94.830000
Train Result:
Gen acc: 99.976562
Time: 430.90s
Adjust Result:
Iters: 1
Gen acc: 94.375000
FGSM acc: 45.625000 -- 42.760000(Testloader)
PGD acc: 5.976562 -- 7.210000(Testloader)
Time: 102.60s
Gen: MobileNetV2 cifar10
Namespace(dataset='cifar10', freeze=False, model='MobileNetV2', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 90.270000
Train Result:
Gen acc: 99.957031
Time: 246.35s
Adjust Result:
Iters: 2
Gen acc: 80.976562
FGSM acc: 37.890625 -- 40.190000(Testloader)
PGD acc: 3.320312 -- 5.590000(Testloader)
Time: 39.31s
Gen: ResNet_152 cifar10
Namespace(dataset='cifar10', freeze=False, model='ResNet_152', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 94.430000
Train Result:
Gen acc: 99.558594
Time: 967.98s
Adjust Result:
Iters: 5
Gen acc: 89.062500
FGSM acc: 42.421875 -- 44.370000(Testloader)
PGD acc: 12.343750 -- 10.190000(Testloader)
Time: 334.84s
Gen: ResNet_18 cifar10
Namespace(dataset='cifar10', freeze=False, model='ResNet_18', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 94.300000
Train Result:
Gen acc: 99.910156
Time: 143.98s
Adjust Result:
Iters: 14
Gen acc: 99.609375
FGSM acc: 47.968750 -- 47.410000(Testloader)
PGD acc: 10.585938 -- 11.240000(Testloader)
Time: 80.04s
Gen: ResNet_50 cifar10
Namespace(dataset='cifar10', freeze=False, model='ResNet_50', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 94.570000
Train Result:
Gen acc: 99.964844
Time: 394.87s
Adjust Result:
Iters: 18
Gen acc: 97.265625
FGSM acc: 46.015625 -- 44.400000(Testloader)
PGD acc: 11.250000 -- 8.920000(Testloader)
Time: 325.25s
Gen: VGG_16 cifar10
Namespace(dataset='cifar10', freeze=False, model='VGG_16', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 93.130000
Train Result:
Gen acc: 99.863281
Time: 131.06s
Adjust Result:
Iters: 7
Gen acc: 99.726562
FGSM acc: 51.640625 -- 53.170000(Testloader)
PGD acc: 20.546875 -- 18.740000(Testloader)
Time: 35.02s
Gen: VGG_19 cifar10
Namespace(dataset='cifar10', freeze=False, model='VGG_19', multi_label_num=2, multi_label_prob=0.4, no_DM=True, noise_scale=1.0, randemb=False)
Test Result:
Teacher Accuray: 93.030000
Train Result:
Gen acc: 99.941406
Time: 147.04s
Adjust Result:
Iters: 21
Gen acc: 97.343750
FGSM acc: 49.375000 -- 50.580000(Testloader)
PGD acc: 14.687500 -- 16.890000(Testloader)
Time: 89.95s
from torch.utils.data import DataLoader
import torchvision
import torchvision.datasets as dsets
import torchvision.transforms as transforms
import os
import sys
import numpy as np
import torch
# CIFAR10提取的图像只有32x32像素,较为模糊,为更清晰显示,使用插值法进行了resize
if __name__ == "__main__":
noise_dir = 'noise_image/'
os.makedirs(noise_dir,exist_ok='True')
noise_scale_list = [1, 0.5, 0.1, 0.05, 0.01, 0.005, 0.001]
batchSize = 1
testloader = DataLoader(
dsets.CIFAR10(root='/lustre/datasets/CIFAR10',
train=False,
transform=transforms.ToTensor(),
download=False),
batch_size = batchSize,
shuffle = False
)
classes = ['plane', 'car', 'bird', 'cat', 'deer', 'dog', 'frog', 'horse', 'ship', 'truck']
for data,target in testloader:
for image, label in zip(data,target):
print(classes[label])
torchvision.utils.save_image(image,noise_dir+'img_org.png')
for i, noise_scale in enumerate(noise_scale_list):
noise = np.random.normal(0., noise_scale, image.size())
noise = torch.tensor(noise).float()
noise_image = image + noise
noise_image.clamp_(0. , 255.)
torchvision.utils.save_image(noise_image,noise_dir+'img_noise'+str(noise_scale)+'.png')
sys.exit()
\ No newline at end of file
from dataloader import DataLoader
from robust_utils import get_adversary
from model import Model
from torch.utils.data import DataLoader
import torchvision
import torchvision.datasets as dsets
import torchvision.transforms as transforms
import os
import sys
import numpy as np
import torch
# CIFAR10提取的图像只有32x32像素,较为模糊,为更清晰显示,下载后进行了resize
# 使用ResNet18进行对抗攻击
if __name__ == "__main__":
adv_dir = 'org_adv_image/'
os.makedirs(adv_dir,exist_ok='True')
model = 'ResNet_18'
dataset = 'cifar10'
batchSize = 1
attack_type = 'pgd'
eps = 8/255
# dataloader = DataLoader(dataset,batchSize)
# _,_,test_loader = dataloader.getloader()
# 这里不需要正则化了
test_loader = DataLoader(
dsets.CIFAR10(root='/lustre/datasets/CIFAR10',
train=False,
transform=transforms.ToTensor(),
download=False),
batch_size = batchSize,
shuffle = True
)
model = Model(model,dataset).cuda()
adversary = get_adversary(model, attack_type, eps, num_classes=10)
classes = ['plane', 'car', 'bird', 'cat', 'deer', 'dog', 'frog', 'horse', 'ship', 'truck']
for inputs,targets in test_loader:
# org
for image, label in zip(inputs,targets):
print(classes[label])
torchvision.utils.save_image(image,adv_dir+'img_org.png')
inputs,targets = inputs.cuda(), targets.cuda()
advs = adversary.perturb(inputs, targets).detach()
for image in advs:
image = image.cpu()
torchvision.utils.save_image(image,adv_dir+'img_adv.png')
# 只取第一个图片
sys.exit()
\ No newline at end of file
#!/bin/bash
#- Job parameters
# (TODO)
# Please modify job name
#SBATCH -J Attack_Visual # The job name
#SBATCH -o ret/ret-%j.out # Write the standard output to file named 'ret-<job_number>.out'
#SBATCH -e ret/ret-%j.err # Write the standard error to file named 'ret-<job_number>.err'
#- Resources
# (TODO)
# Please modify your requirements
#SBATCH -p nv-gpu # Submit to 'nv-gpu' Partitiion
#SBATCH -t 0-04:00:00 # Run for a maximum time of 0 days, 12 hours, 00 mins, 00 secs
#SBATCH --nodes=1 # Request N nodes
#SBATCH --gres=gpu:1 # Request M GPU per node
#SBATCH --gres-flags=enforce-binding # CPU-GPU Affinity
#SBATCH --qos=gpu-debug # Request QOS Type
###
### The system will alloc 8 or 16 cores per gpu by default.
### If you need more or less, use following:
### #SBATCH --cpus-per-task=K # Request K cores
###
###
### Without specifying the constraint, any available nodes that meet the requirement will be allocated
### You can specify the characteristics of the compute nodes, and even the names of the compute nodes
###
### #SBATCH --nodelist=gpu-v00 # Request a specific list of hosts
### #SBATCH --constraint="Volta|RTX8000" # Request GPU Type: Volta(V100 or V100S) or RTX8000
###
# set constraint for RTX8000 to meet my cuda
#SBATCH --constraint="Ampere|RTX8000|Volta"
#- Log information
echo "Job start at $(date "+%Y-%m-%d %H:%M:%S")"
echo "Job run at:"
echo "$(hostnamectl)"
#- Load environments
source /tools/module_env.sh
module list # list modules loaded
##- Tools
module load cluster-tools/v1.0
module load slurm-tools/v1.0
module load cmake/3.15.7
module load git/2.17.1
module load vim/8.1.2424
##- language
module load python3/3.8.16
##- CUDA
# module load cuda-cudnn/10.2-7.6.5
# module load cuda-cudnn/11.2-8.2.1
module load cuda-cudnn/11.1-8.2.1
##- virtualenv
# source xxxxx/activate
echo $(module list) # list modules loaded
echo $(which gcc)
echo $(which python)
echo $(which python3)
cluster-quota # nas quota
nvidia-smi --format=csv --query-gpu=name,driver_version,power.limit # gpu info
#- Warning! Please not change your CUDA_VISIBLE_DEVICES
#- in `.bashrc`, `env.sh`, or your job script
echo "Use GPU ${CUDA_VISIBLE_DEVICES}" # which gpus
#- The CUDA_VISIBLE_DEVICES variable is assigned and specified by SLURM
#- Job step
# [EDIT HERE(TODO)]
python robust_attack_visual.py
#- End
echo "Job end at $(date "+%Y-%m-%d %H:%M:%S")"
"""
利用PCA降维可视化伪数据所得特征与模型分类结果/生成器输入标签关系,从而观测决策边界
模型分类结果out表示该模型的决策边界
生成器输入标签label表示生成器所拟合的边界
针对cifar10数据集下ResNet_18生成可视化图像
以ResNet18为例,利用PCA降维可视化测试集/未调整生成器和调整后生成器的数据分布
"""
from model import Model
from dataloader import DataLoader
from gen_one import GenOption
import os
import argparse
import numpy as np
import pandas as pd
from scipy.linalg import eigh
import torch
import torch.nn as nn
import torchvision
from torchvision import datasets, transforms
import seaborn as sns
from matplotlib import pyplot as plt
from sklearn.preprocessing import StandardScaler
from sklearn.decomposition import PCA
parser = argparse.ArgumentParser(description='PCA features')
# 获取测试集在model上分布图
parser.add_argument('--pca_src', action='store_true')
# 未调整生成器伪数据的分布图
parser.add_argument('--pca_gen_org', action='store_true')
# 调整后生成器伪数据的分布图
parser.add_argument('--pca_gen_adjust', action='store_true')
# # 指定选择哪个模型对应的生成器
# parser.add_argument('--quant',action='store_true')
# # 当选择的为量化网络时,下述参数才生效
# parser.add_argument('--quant_type',type=str,default='NONE')
# parser.add_argument('--num_bits',type=int,default=0)
# parser.add_argument('--e_bits',type=int,default=0)
def reduce_df(dataframe, num_per_class):
df_list = []
for i in range(10):
df_list.append(dataframe.iloc[i * 1000: i * 1000 + num_per_class])
df = pd.concat(df_list)
return df
if __name__ == '__main__':
args = parser.parse_args()
# 确定模型及生成器路径
model_name = 'ResNet_18'
# model_name = 'ResNet_50'
model_file = 'ckpt_full/cifar10/'+model_name+'.pt'
if args.pca_gen_org:
gen_org_file = 'ckpt_gen/cifar10/'+model_name+'.pt'
gen_org = torch.load(gen_org_file)
gen_org.eval()
if args.pca_gen_adjust:
gen_adjust_file = 'ckpt_gen/cifar10/'+model_name+'_adjust.pt'
gen_adjust = torch.load(gen_adjust_file)
gen_adjust.eval()
pca_dir = 'pca_'+model_name+'_cifar10/'
if True in [args.pca_src, args.pca_gen_org, args.pca_gen_adjust]:
os.makedirs(pca_dir, exist_ok=True)
model = Model(model_name=model_name,dataset='cifar10').cuda()
model.load_state_dict(torch.load(model_file))
model.eval()
print('Model Ready')
dataloader = DataLoader('cifar10',200)
_,_,test_loader = dataloader.getloader()
features = []
targets = []
with torch.no_grad():
for i, (data, target) in enumerate(test_loader):
data = data.cuda()
_, feature = model(data, out_feature=True)
features.append(feature.cpu())
targets.append(target)
features_cat = torch.cat(features, dim=0)
targets_cat = torch.cat(targets, dim=0)
feature_scaler = StandardScaler().fit(features_cat)
standardized_data = feature_scaler.transform(features_cat)
covar_matrix = np.matmul(standardized_data.T , standardized_data)
values, vectors = eigh(covar_matrix, eigvals=(510,511))
vectors = vectors.T
if args.pca_src:
print('pca of source data')
new_coordinates = np.matmul(vectors, standardized_data.T)
new_coordinates = np.vstack((new_coordinates, targets_cat)).T
dataframe = pd.DataFrame(data=new_coordinates, columns=("1st_principal", "2nd_principal", "label"))
dataframe.sort_values(by=['label'], axis=0, inplace=True)
df = reduce_df(dataframe, 1000)
pca_result = sns.FacetGrid(df, hue="label", height=10, hue_kws={'marker':['x'] * 10}).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_dir+'pca_src.png')
if args.pca_gen_org:
print('pca of gen before adjust')
features_gen = []
targets_gen = []
with torch.no_grad():
for i in range(50):
z = torch.randn(200, 512).cuda()
labels = (torch.ones(200) * (i // 5)).type(torch.LongTensor)
targets_gen.append(labels)
labels = labels.cuda()
z = z.contiguous()
labels = labels.contiguous()
images = gen_org(z, labels)
_, feature = model(images, out_feature=True)
features_gen.append(feature.cpu())
features_cat_gen = torch.cat(features_gen, dim=0)
targets_cat_gen = torch.cat(targets_gen, dim=0)
standardized_data_gen = feature_scaler.transform(features_cat_gen)
new_coordinates_gen = np.matmul(vectors, standardized_data_gen.T)
new_coordinates_gen = np.vstack((new_coordinates_gen, targets_cat_gen)).T
dataframe_gen = pd.DataFrame(data=new_coordinates_gen, columns=("1st_principal", "2nd_principal", "label"))
pca_result = sns.FacetGrid(dataframe_gen, hue="label", height=10, hue_kws={'marker':['x'] * 10}).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_dir+'pca_gen_org.png')
if args.pca_gen_adjust:
print('pca of gen after adjust')
features_gen = []
targets_gen = []
with torch.no_grad():
for i in range(50):
z = torch.randn(200, 512).cuda()
labels = (torch.ones(200) * (i // 5)).type(torch.LongTensor)
targets_gen.append(labels)
labels = labels.cuda()
z = z.contiguous()
labels = labels.contiguous()
images = gen_adjust(z, labels)
_, feature = model(images, out_feature=True)
features_gen.append(feature.cpu())
features_cat_gen = torch.cat(features_gen, dim=0)
targets_cat_gen = torch.cat(targets_gen, dim=0)
standardized_data_gen = feature_scaler.transform(features_cat_gen)
new_coordinates_gen = np.matmul(vectors, standardized_data_gen.T)
new_coordinates_gen = np.vstack((new_coordinates_gen, targets_cat_gen)).T
dataframe_gen = pd.DataFrame(data=new_coordinates_gen, columns=("1st_principal", "2nd_principal", "label"))
pca_result = sns.FacetGrid(dataframe_gen, hue="label", height=10, hue_kws={'marker':['x'] * 10}).map(plt.scatter, '1st_principal', '2nd_principal')
pca_result.set(xticks=[], yticks=[], xlabel='', ylabel='')
plt.savefig(pca_dir+'pca_gen_adjust.png')
\ No newline at end of file
...@@ -5,7 +5,7 @@ ...@@ -5,7 +5,7 @@
# (TODO) # (TODO)
# Please modify job name # Please modify job name
#SBATCH -J Boundary # The job name #SBATCH -J Distribution # The job name
#SBATCH -o ret/ret-%j.out # Write the standard output to file named 'ret-<job_number>.out' #SBATCH -o ret/ret-%j.out # Write the standard output to file named 'ret-<job_number>.out'
#SBATCH -e ret/ret-%j.err # Write the standard error to file named 'ret-<job_number>.err' #SBATCH -e ret/ret-%j.err # Write the standard error to file named 'ret-<job_number>.err'
...@@ -82,12 +82,8 @@ echo "Use GPU ${CUDA_VISIBLE_DEVICES}" # which gpus ...@@ -82,12 +82,8 @@ echo "Use GPU ${CUDA_VISIBLE_DEVICES}" # which gpus
#- Job step #- Job step
# [EDIT HERE(TODO)] # [EDIT HERE(TODO)]
### FULL
python boundary_visualize.py --pca_gen --pca_mix --pca_path
# ### quant python robust_distribution.py --pca_src --pca_gen_org --pca_gen_adjust
python boundary_visualize.py --pca_gen --pca_mix --pca_path --quant --quant_type=INT --num_bits=4
python boundary_visualize.py --pca_gen --pca_mix --pca_path --quant --quant_type=INT --num_bits=5
# python boundary_visualize.py --pca_gen --pca_mix --pca_path --quant --quant_type=INT --num_bits=16
#- End #- End
echo "Job end at $(date "+%Y-%m-%d %H:%M:%S")" echo "Job end at $(date "+%Y-%m-%d %H:%M:%S")"
...@@ -11,11 +11,11 @@ ...@@ -11,11 +11,11 @@
# Please modify your requirements # Please modify your requirements
#SBATCH -p nv-gpu # Submit to 'nv-gpu' Partitiion #SBATCH -p nv-gpu # Submit to 'nv-gpu' Partitiion
#SBATCH -t 1-06:00:00 # Run for a maximum time of 0 days, 12 hours, 00 mins, 00 secs ## #SBATCH -t 1-06:00:00 # Run for a maximum time of 0 days, 12 hours, 00 mins, 00 secs
#SBATCH --nodes=1 # Request N nodes #SBATCH --nodes=1 # Request N nodes
#SBATCH --gres=gpu:1 # Request M GPU per node #SBATCH --gres=gpu:1 # Request M GPU per node
#SBATCH --gres-flags=enforce-binding # CPU-GPU Affinity #SBATCH --gres-flags=enforce-binding # CPU-GPU Affinity
#SBATCH --qos=gpu-normal # Request QOS Type ## #SBATCH --qos=gpu-normal # Request QOS Type
### ###
### The system will alloc 8 or 16 cores per gpu by default. ### The system will alloc 8 or 16 cores per gpu by default.
...@@ -86,8 +86,9 @@ else ...@@ -86,8 +86,9 @@ else
exit exit
fi fi
python robust_one.py --model $Model --dataset $Dataset --multi_label_num $Label --adjust # python robust_one.py --model $Model --dataset $Dataset --multi_label_num $Label --adjust
python robust_one.py --model $Model --dataset $Dataset --multi_label_num $Label # Adjust根据传入的参数决定,可能是'--adjust'或''
python robust_one.py --model $Model --dataset $Dataset --multi_label_num $Label $Adjust
#- End #- End
echo "Job end at $(date "+%Y-%m-%d %H:%M:%S")" echo "Job end at $(date "+%Y-%m-%d %H:%M:%S")"
AlexNet cifar10 AlexNet cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 88.640000 99.726562 45.340000 60.039062 19.860000 34.625000 12.48s Full 88.640000 99.960938 45.340000 89.914062 19.850000 62.492188 11.31s
INT_2 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 27.51s INT_2 10.000000 10.437500 10.000000 10.437500 10.000000 10.437500 26.55s
INT_3 10.120000 12.867188 10.000000 9.859375 10.000000 9.859375 28.69s INT_3 10.120000 11.734375 10.000000 9.632812 10.000000 9.632812 22.62s
INT_4 55.640000 61.656250 13.900000 24.125000 11.280000 18.562500 24.35s INT_4 55.750000 75.382812 14.120000 22.250000 11.390000 15.382812 20.36s
INT_5 82.880000 97.656250 37.790000 47.492188 29.120000 39.851562 29.08s INT_5 82.850000 99.531250 38.530000 75.031250 28.830000 65.015625 20.23s
INT_6 87.300000 99.601562 44.420000 57.523438 30.590000 44.406250 28.29s INT_6 87.290000 99.945312 44.240000 87.875000 30.120000 75.750000 20.20s
INT_7 88.230000 99.687500 44.040000 64.289062 25.940000 45.078125 26.63s INT_7 88.240000 99.960938 44.390000 89.789062 26.160000 74.343750 20.24s
INT_8 88.450000 99.750000 45.230000 60.523438 23.230000 38.359375 29.04s INT_8 88.440000 99.960938 45.000000 89.664062 23.040000 68.093750 20.24s
INT_9 88.630000 99.703125 45.200000 60.445312 21.140000 35.984375 26.95s INT_9 88.610000 99.960938 45.130000 90.109375 21.220000 65.328125 20.23s
INT_10 88.700000 99.726562 45.230000 59.882812 20.510000 35.289062 26.87s INT_10 88.730000 99.960938 45.260000 90.015625 20.480000 63.531250 20.12s
INT_11 88.660000 99.726562 45.250000 60.046875 20.100000 34.851562 25.40s INT_11 88.650000 99.960938 45.280000 89.960938 20.050000 62.906250 20.19s
INT_12 88.660000 99.734375 45.260000 60.109375 19.830000 34.804688 26.59s INT_12 88.670000 99.960938 45.300000 89.968750 19.880000 62.554688 20.45s
INT_13 88.630000 99.726562 45.250000 60.039062 19.860000 34.640625 28.14s INT_13 88.620000 99.960938 45.200000 90.007812 19.900000 62.578125 20.25s
INT_14 88.630000 99.726562 45.230000 59.992188 19.820000 34.687500 28.48s INT_14 88.650000 99.960938 45.210000 89.953125 19.880000 62.492188 20.26s
INT_15 88.620000 99.726562 45.390000 60.000000 19.920000 34.617188 26.30s INT_15 88.620000 99.960938 45.380000 89.929688 19.830000 62.437500 20.26s
INT_16 88.630000 99.726562 45.350000 60.039062 19.840000 34.679688 26.49s INT_16 88.640000 99.960938 45.320000 89.960938 19.850000 62.523438 20.29s
POT_2 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 37.71s POT_2 10.000000 10.437500 10.000000 10.437500 10.000000 10.437500 34.96s
POT_3 16.660000 22.515625 10.010000 9.859375 10.000000 9.859375 38.29s POT_3 16.660000 30.554688 10.010000 9.632812 10.010000 9.632812 32.22s
POT_4 69.810000 93.085938 28.190000 31.140625 17.220000 22.968750 44.90s POT_4 69.730000 99.171875 28.580000 62.804688 17.170000 48.992188 36.97s
POT_5 69.760000 94.015625 27.550000 30.828125 15.820000 22.289062 53.51s POT_5 69.830000 99.304688 27.640000 62.695312 15.520000 47.343750 45.75s
POT_6 70.680000 93.789062 27.980000 29.921875 15.690000 22.023438 74.98s POT_6 70.690000 99.382812 27.670000 61.929688 15.510000 46.531250 61.38s
POT_7 70.320000 94.070312 28.060000 30.867188 15.880000 22.164062 118.00s POT_7 70.350000 99.312500 27.930000 62.578125 15.420000 46.468750 94.38s
POT_8 69.810000 93.976562 27.690000 30.664062 15.670000 22.210938 201.64s POT_8 69.920000 99.343750 27.700000 62.656250 15.520000 46.976562 161.26s
FLOAT_3_E1 23.220000 27.843750 14.160000 22.140625 11.230000 17.406250 38.73s FLOAT_3_E1 23.120000 33.960938 13.860000 25.132812 11.250000 20.429688 34.52s
FLOAT_4_E1 68.120000 91.484375 23.850000 34.398438 17.930000 27.429688 44.20s FLOAT_4_E1 68.090000 97.070312 23.440000 53.890625 17.740000 43.609375 37.20s
FLOAT_4_E2 66.360000 85.289062 24.400000 34.234375 20.050000 31.000000 43.02s FLOAT_4_E2 66.710000 94.031250 24.620000 48.960938 20.250000 42.828125 36.16s
FLOAT_5_E1 79.430000 98.726562 29.100000 47.679688 18.930000 33.992188 54.85s FLOAT_5_E1 79.520000 99.773438 29.100000 71.937500 19.090000 55.757812 43.69s
FLOAT_5_E2 84.020000 97.804688 37.570000 55.046875 24.200000 39.953125 54.37s FLOAT_5_E2 84.000000 99.726562 37.430000 79.390625 24.000000 64.859375 44.62s
FLOAT_5_E3 85.030000 99.250000 39.370000 55.171875 19.650000 32.359375 54.10s FLOAT_5_E3 84.950000 99.875000 38.840000 81.726562 19.550000 58.640625 45.43s
FLOAT_6_E1 83.350000 98.812500 32.690000 61.523438 18.640000 41.695312 75.39s FLOAT_6_E1 83.280000 99.914062 33.300000 82.687500 18.560000 63.367188 59.82s
FLOAT_6_E2 87.150000 99.632812 40.570000 50.257812 22.020000 32.414062 75.66s FLOAT_6_E2 87.120000 99.937500 40.580000 83.664062 22.110000 63.250000 59.52s
FLOAT_6_E3 87.980000 99.648438 44.120000 67.335938 20.330000 39.570312 75.61s FLOAT_6_E3 88.000000 99.929688 44.280000 90.867188 20.340000 68.109375 59.69s
FLOAT_6_E4 85.250000 99.250000 39.030000 53.781250 19.680000 31.476562 75.94s FLOAT_6_E4 85.230000 99.882812 39.070000 81.453125 19.720000 58.398438 59.83s
FLOAT_7_E1 85.030000 99.195312 35.290000 68.187500 17.640000 45.750000 118.53s FLOAT_7_E1 85.030000 99.929688 35.350000 86.320312 18.260000 65.757812 94.31s
FLOAT_7_E2 87.490000 99.750000 41.860000 48.734375 20.750000 28.445312 118.74s FLOAT_7_E2 87.510000 99.929688 41.750000 84.382812 20.890000 60.445312 93.92s
FLOAT_7_E3 88.610000 99.765625 44.980000 59.601562 19.960000 35.289062 118.59s FLOAT_7_E3 88.610000 99.960938 44.920000 89.023438 20.010000 62.648438 94.56s
FLOAT_7_E4 88.090000 99.671875 43.810000 67.312500 20.060000 39.593750 118.47s FLOAT_7_E4 88.130000 99.937500 44.250000 90.664062 20.200000 68.085938 94.28s
FLOAT_7_E5 85.270000 99.296875 39.270000 53.632812 19.510000 31.132812 118.94s FLOAT_7_E5 85.240000 99.906250 39.020000 81.250000 19.680000 58.492188 92.55s
FLOAT_8_E1 86.080000 99.320312 36.530000 69.195312 17.620000 45.312500 202.51s FLOAT_8_E1 86.020000 99.906250 36.560000 87.281250 17.650000 65.671875 159.21s
FLOAT_8_E2 87.870000 99.640625 41.830000 47.335938 19.320000 26.867188 202.51s FLOAT_8_E2 87.880000 99.937500 41.990000 84.531250 19.320000 58.984375 159.44s
FLOAT_8_E3 88.730000 99.757812 44.970000 60.351562 19.860000 35.195312 202.19s FLOAT_8_E3 88.700000 99.968750 44.790000 89.960938 19.840000 63.648438 161.67s
FLOAT_8_E4 88.630000 99.781250 44.840000 59.601562 19.950000 34.890625 202.12s FLOAT_8_E4 88.610000 99.960938 44.910000 89.015625 19.960000 62.531250 161.05s
FLOAT_8_E5 88.150000 99.648438 44.280000 67.242188 20.160000 39.281250 202.64s FLOAT_8_E5 88.230000 99.937500 44.220000 90.843750 19.940000 68.031250 161.62s
FLOAT_8_E6 85.200000 99.281250 38.980000 53.492188 19.830000 30.859375 202.72s FLOAT_8_E6 85.210000 99.867188 39.010000 81.570312 19.490000 58.164062 161.74s
AlexNet_BN cifar10 AlexNet_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.130000 99.843750 48.620000 64.164062 19.220000 23.390625 14.21s Full 90.130000 99.976562 48.610000 67.304688 19.190000 28.429688 11.62s
INT_2 10.000000 9.796875 10.000000 9.796875 10.000000 9.796875 28.30s INT_2 10.000000 10.156250 10.000000 10.156250 10.000000 10.156250 21.60s
INT_3 14.040000 16.929688 10.000000 9.796875 10.000000 9.796875 31.25s INT_3 14.040000 17.890625 10.000000 10.156250 10.000000 10.156250 33.12s
INT_4 48.760000 62.328125 15.280000 17.804688 13.540000 15.468750 35.92s INT_4 48.760000 74.398438 15.290000 13.703125 13.590000 9.960938 25.82s
INT_5 76.310000 96.093750 23.750000 32.851562 16.270000 23.593750 28.12s INT_5 76.320000 99.343750 23.810000 42.835938 16.590000 30.820312 22.04s
INT_6 88.910000 99.375000 43.970000 65.976562 24.860000 43.390625 31.49s INT_6 88.930000 99.937500 44.050000 69.210938 25.140000 42.804688 36.14s
INT_7 89.790000 99.875000 47.430000 65.625000 24.060000 32.945312 33.04s INT_7 89.790000 99.968750 47.510000 66.906250 24.320000 34.296875 34.73s
INT_8 90.240000 99.828125 47.930000 65.617188 21.380000 28.531250 34.08s INT_8 90.270000 99.960938 47.840000 68.234375 21.490000 31.757812 35.67s
INT_9 90.070000 99.835938 48.230000 64.531250 20.100000 24.960938 31.51s INT_9 90.050000 99.976562 48.260000 67.492188 20.100000 29.445312 36.22s
INT_10 90.100000 99.843750 48.380000 64.101562 19.560000 24.078125 31.64s INT_10 90.100000 99.976562 48.450000 67.679688 19.650000 29.046875 36.48s
INT_11 90.120000 99.843750 48.360000 64.320312 19.390000 23.601562 30.91s INT_11 90.120000 99.976562 48.390000 67.460938 19.400000 28.601562 32.79s
INT_12 90.160000 99.843750 48.490000 63.929688 19.300000 23.343750 33.59s INT_12 90.160000 99.976562 48.540000 67.273438 19.290000 28.453125 33.57s
INT_13 90.140000 99.843750 48.490000 64.062500 19.200000 23.414062 37.41s INT_13 90.140000 99.976562 48.500000 67.312500 19.320000 28.453125 35.52s
INT_14 90.130000 99.843750 48.550000 64.062500 19.200000 23.320312 34.77s INT_14 90.130000 99.976562 48.530000 67.289062 19.110000 28.406250 36.37s
INT_15 90.140000 99.843750 48.650000 64.125000 19.310000 23.312500 34.93s INT_15 90.140000 99.976562 48.660000 67.335938 19.200000 28.406250 35.24s
INT_16 90.130000 99.843750 48.610000 64.179688 19.170000 23.242188 27.59s INT_16 90.130000 99.976562 48.590000 67.382812 19.280000 28.468750 35.09s
POT_2 10.000000 9.796875 10.000000 9.796875 10.000000 9.796875 40.82s POT_2 10.000000 10.156250 10.000000 10.156250 10.000000 10.156250 37.73s
POT_3 17.480000 21.945312 10.930000 17.320312 10.470000 16.445312 39.56s POT_3 17.430000 25.765625 10.020000 14.835938 9.950000 13.992188 42.93s
POT_4 74.750000 94.773438 28.570000 30.968750 16.050000 20.554688 46.32s POT_4 74.760000 99.062500 28.610000 36.507812 16.140000 24.250000 42.19s
POT_5 74.280000 95.609375 30.290000 34.664062 16.780000 23.367188 56.10s POT_5 74.240000 99.093750 29.910000 37.445312 17.070000 23.445312 47.22s
POT_6 74.770000 94.875000 30.550000 32.242188 17.040000 21.546875 77.70s POT_6 74.820000 99.070312 30.580000 36.539062 16.690000 23.656250 59.03s
POT_7 74.510000 94.929688 30.430000 32.617188 16.910000 21.593750 120.50s POT_7 74.470000 99.093750 30.410000 36.781250 16.600000 23.429688 91.95s
POT_8 74.440000 94.882812 30.590000 32.570312 17.060000 21.695312 203.68s POT_8 74.430000 99.062500 30.620000 36.375000 17.170000 23.664062 160.59s
FLOAT_3_E1 23.080000 29.265625 10.980000 12.031250 10.450000 9.218750 40.04s FLOAT_3_E1 23.080000 30.632812 11.260000 12.554688 10.660000 11.289062 36.55s
FLOAT_4_E1 68.200000 85.187500 20.790000 39.726562 14.550000 26.523438 46.18s FLOAT_4_E1 68.170000 92.265625 20.750000 40.234375 14.390000 27.406250 41.31s
FLOAT_4_E2 72.840000 75.398438 24.180000 25.703125 18.250000 14.500000 46.47s FLOAT_4_E2 72.820000 94.984375 24.140000 36.531250 17.950000 29.382812 40.24s
FLOAT_5_E1 82.640000 97.960938 33.660000 37.171875 19.340000 21.437500 56.24s FLOAT_5_E1 82.610000 99.281250 33.740000 53.000000 19.710000 30.765625 47.46s
FLOAT_5_E2 85.490000 97.875000 39.450000 52.281250 22.870000 36.187500 56.42s FLOAT_5_E2 85.470000 99.773438 39.440000 49.210938 22.890000 31.976562 46.36s
FLOAT_5_E3 87.690000 99.500000 44.720000 39.648438 22.760000 8.898438 55.78s FLOAT_5_E3 87.700000 99.898438 44.720000 54.546875 22.590000 27.132812 43.32s
FLOAT_6_E1 85.790000 98.984375 40.120000 41.929688 20.980000 20.867188 77.81s FLOAT_6_E1 85.780000 99.742188 40.120000 51.828125 21.000000 27.710938 62.65s
FLOAT_6_E2 87.740000 99.203125 42.470000 58.515625 21.300000 29.851562 77.15s FLOAT_6_E2 87.750000 99.929688 42.450000 54.093750 21.100000 31.609375 63.73s
FLOAT_6_E3 89.570000 99.804688 48.220000 62.257812 21.390000 31.390625 77.14s FLOAT_6_E3 89.550000 99.968750 48.260000 65.695312 21.620000 28.757812 63.61s
FLOAT_6_E4 87.980000 99.492188 45.690000 39.554688 22.790000 9.023438 77.11s FLOAT_6_E4 88.000000 99.898438 45.590000 55.273438 22.930000 27.945312 62.84s
FLOAT_7_E1 86.840000 99.039062 41.350000 42.812500 19.330000 18.835938 120.79s FLOAT_7_E1 86.830000 99.851562 41.340000 53.375000 19.440000 27.085938 95.38s
FLOAT_7_E2 88.630000 99.546875 44.440000 60.148438 21.050000 27.734375 120.65s FLOAT_7_E2 88.650000 99.960938 44.810000 59.593750 20.980000 30.406250 92.52s
FLOAT_7_E3 89.950000 99.812500 48.060000 64.007812 19.780000 23.828125 120.79s FLOAT_7_E3 89.930000 99.976562 48.130000 66.914062 19.650000 30.203125 95.62s
FLOAT_7_E4 89.280000 99.773438 48.030000 62.218750 21.390000 30.929688 120.54s FLOAT_7_E4 89.280000 99.960938 48.080000 64.726562 21.560000 28.585938 95.99s
FLOAT_7_E5 87.790000 99.562500 45.490000 39.453125 22.620000 9.007812 120.39s FLOAT_7_E5 87.810000 99.906250 45.390000 55.476562 22.670000 27.445312 92.61s
FLOAT_8_E1 86.990000 99.125000 42.250000 44.859375 19.130000 18.960938 203.77s FLOAT_8_E1 86.990000 99.867188 42.260000 54.820312 18.980000 27.117188 161.30s
FLOAT_8_E2 88.850000 99.679688 44.820000 61.281250 20.120000 26.546875 203.59s FLOAT_8_E2 88.870000 99.929688 44.850000 60.468750 20.070000 29.796875 162.49s
FLOAT_8_E3 90.120000 99.835938 48.090000 64.414062 19.210000 24.250000 203.75s FLOAT_8_E3 90.100000 99.976562 48.020000 67.773438 19.310000 29.164062 162.06s
FLOAT_8_E4 89.810000 99.804688 48.030000 63.921875 19.600000 23.882812 203.55s FLOAT_8_E4 89.800000 99.976562 48.030000 66.960938 19.850000 30.078125 162.40s
FLOAT_8_E5 89.560000 99.804688 48.230000 62.453125 21.530000 31.429688 203.70s FLOAT_8_E5 89.560000 99.968750 48.370000 65.421875 21.540000 28.804688 162.15s
FLOAT_8_E6 87.870000 99.515625 45.530000 39.664062 22.880000 9.023438 204.57s FLOAT_8_E6 87.880000 99.890625 45.520000 55.187500 22.780000 28.109375 162.52s
AlexNet_BN cifar10 AlexNet_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.130000 98.140625 48.620000 53.664062 19.240000 21.531250 14.11s Full 90.130000 91.062500 48.610000 38.828125 19.260000 21.398438 12.66s
INT_2 10.000000 9.859375 10.000000 9.859375 10.000000 9.859375 35.01s INT_2 10.000000 10.296875 10.000000 10.296875 10.000000 10.296875 35.11s
INT_3 14.040000 14.937500 10.000000 9.859375 10.000000 9.859375 32.19s INT_3 14.040000 12.007812 10.000000 10.296875 10.000000 10.296875 36.84s
INT_4 48.760000 50.593750 15.270000 15.078125 13.680000 11.140625 33.45s INT_4 48.760000 28.273438 14.790000 10.976562 13.390000 9.742188 35.88s
INT_5 76.310000 89.203125 23.770000 24.539062 16.410000 15.882812 35.46s INT_5 76.320000 64.187500 23.870000 22.929688 16.550000 18.015625 36.24s
INT_6 88.910000 97.398438 44.340000 59.687500 25.030000 34.093750 34.29s INT_6 88.930000 81.875000 44.510000 36.875000 24.740000 25.710938 36.44s
INT_7 89.790000 98.390625 47.460000 57.789062 24.340000 28.945312 34.86s INT_7 89.790000 91.179688 47.360000 37.539062 24.110000 23.421875 36.47s
INT_8 90.240000 98.226562 48.240000 55.875000 21.340000 24.593750 28.40s INT_8 90.270000 90.492188 47.970000 38.859375 21.460000 23.406250 35.81s
INT_9 90.070000 98.210938 48.250000 54.171875 20.160000 22.367188 35.74s INT_9 90.050000 91.093750 48.450000 38.812500 20.380000 22.164062 26.21s
INT_10 90.100000 98.148438 48.370000 53.789062 19.640000 22.046875 27.08s INT_10 90.100000 91.007812 48.340000 38.875000 19.710000 21.765625 35.04s
INT_11 90.120000 98.140625 48.360000 53.882812 19.380000 21.640625 28.42s INT_11 90.120000 91.054688 48.290000 38.789062 19.300000 21.656250 23.97s
INT_12 90.160000 98.156250 48.430000 53.468750 19.290000 21.445312 35.95s INT_12 90.160000 91.062500 48.470000 38.757812 19.310000 21.468750 35.02s
INT_13 90.140000 98.164062 48.510000 53.726562 19.230000 21.523438 33.68s INT_13 90.140000 91.062500 48.510000 38.757812 19.140000 21.421875 34.42s
INT_14 90.130000 98.156250 48.610000 53.640625 19.320000 21.492188 35.24s INT_14 90.130000 91.062500 48.620000 38.789062 19.210000 21.414062 30.86s
INT_15 90.140000 98.156250 48.630000 53.695312 19.190000 21.484375 32.02s INT_15 90.140000 91.062500 48.630000 38.765625 19.290000 21.382812 34.77s
INT_16 90.130000 98.148438 48.590000 53.648438 19.190000 21.468750 30.39s INT_16 90.130000 91.054688 48.570000 38.765625 19.270000 21.437500 35.31s
POT_2 10.000000 9.859375 10.000000 9.859375 10.000000 9.859375 36.74s POT_2 10.000000 10.296875 10.000000 10.296875 10.000000 10.296875 46.27s
POT_3 17.480000 18.789062 10.110000 11.898438 10.070000 9.265625 39.12s POT_3 17.430000 18.187500 10.000000 11.531250 10.220000 11.460938 40.41s
POT_4 74.750000 82.226562 28.580000 19.375000 16.420000 4.570312 44.06s POT_4 74.770000 73.265625 28.550000 26.367188 16.370000 20.390625 40.61s
POT_5 74.280000 82.382812 30.280000 20.734375 16.600000 3.804688 54.91s POT_5 74.240000 72.046875 30.290000 30.625000 16.890000 23.726562 49.17s
POT_6 74.770000 81.304688 30.540000 19.132812 16.790000 3.882812 75.97s POT_6 74.800000 73.281250 30.580000 27.718750 17.060000 20.828125 62.51s
POT_7 74.510000 81.250000 30.410000 19.304688 17.110000 4.023438 120.26s POT_7 74.470000 73.250000 30.400000 27.960938 16.990000 20.898438 95.41s
POT_8 74.440000 81.210938 30.580000 19.148438 16.620000 4.062500 202.14s POT_8 74.430000 73.585938 30.560000 27.765625 16.850000 20.468750 161.43s
FLOAT_3_E1 23.080000 30.210938 11.580000 12.078125 10.740000 10.859375 38.64s FLOAT_3_E1 23.080000 25.921875 11.380000 14.140625 10.840000 13.039062 40.21s
FLOAT_4_E1 68.200000 79.320312 20.760000 27.664062 14.320000 22.875000 43.86s FLOAT_4_E1 68.170000 60.023438 21.470000 29.671875 14.870000 24.898438 39.26s
FLOAT_4_E2 72.840000 62.210938 24.170000 24.750000 18.080000 20.062500 44.07s FLOAT_4_E2 72.810000 49.695312 24.190000 20.257812 18.220000 17.062500 38.71s
FLOAT_5_E1 82.640000 93.945312 34.060000 25.593750 19.360000 8.656250 54.97s FLOAT_5_E1 82.610000 76.593750 34.510000 29.273438 19.630000 22.343750 45.00s
FLOAT_5_E2 85.490000 93.062500 39.460000 45.640625 22.900000 32.156250 55.10s FLOAT_5_E2 85.470000 78.242188 39.400000 27.156250 22.580000 18.781250 42.46s
FLOAT_5_E3 87.690000 97.679688 44.720000 52.140625 22.650000 33.414062 56.69s FLOAT_5_E3 87.700000 88.054688 45.120000 33.617188 22.630000 22.179688 42.63s
FLOAT_6_E1 85.790000 97.007812 40.050000 23.304688 20.800000 2.242188 78.21s FLOAT_6_E1 85.780000 82.664062 39.940000 30.523438 20.840000 21.328125 58.43s
FLOAT_6_E2 87.740000 96.273438 42.320000 46.750000 21.030000 23.171875 78.11s FLOAT_6_E2 87.750000 83.468750 42.580000 31.382812 21.330000 19.210938 58.39s
FLOAT_6_E3 89.570000 98.117188 48.210000 54.781250 21.460000 33.867188 77.11s FLOAT_6_E3 89.550000 88.476562 48.230000 35.531250 21.740000 20.460938 58.47s
FLOAT_6_E4 87.980000 97.796875 45.490000 51.765625 22.620000 33.242188 77.57s FLOAT_6_E4 87.990000 87.625000 45.560000 33.328125 22.570000 21.968750 58.41s
FLOAT_7_E1 86.840000 97.500000 40.980000 23.367188 19.280000 2.437500 120.82s FLOAT_7_E1 86.830000 85.484375 41.060000 30.273438 19.290000 19.765625 95.96s
FLOAT_7_E2 88.630000 97.476562 44.790000 49.515625 21.340000 21.687500 120.77s FLOAT_7_E2 88.640000 87.718750 44.460000 33.757812 21.010000 19.914062 95.70s
FLOAT_7_E3 89.950000 98.000000 47.930000 54.250000 19.720000 23.625000 120.26s FLOAT_7_E3 89.930000 90.515625 48.110000 38.796875 19.820000 22.070312 93.19s
FLOAT_7_E4 89.280000 98.210938 48.330000 54.109375 21.410000 33.726562 121.09s FLOAT_7_E4 89.260000 88.460938 48.030000 35.656250 21.460000 20.367188 95.11s
FLOAT_7_E5 87.790000 97.656250 44.930000 50.390625 22.760000 32.015625 120.11s FLOAT_7_E5 87.810000 87.570312 45.390000 33.289062 22.500000 22.054688 95.74s
FLOAT_8_E1 86.990000 97.312500 42.130000 24.601562 18.890000 2.265625 204.38s FLOAT_8_E1 86.990000 86.273438 41.880000 30.812500 19.240000 19.695312 161.59s
FLOAT_8_E2 88.850000 97.835938 44.780000 50.250000 20.240000 21.273438 203.89s FLOAT_8_E2 88.870000 88.820312 45.090000 35.101562 20.180000 21.062500 161.42s
FLOAT_8_E3 90.120000 97.992188 47.990000 53.593750 19.320000 21.429688 203.68s FLOAT_8_E3 90.100000 90.664062 47.900000 38.351562 19.290000 21.515625 161.45s
FLOAT_8_E4 89.810000 97.984375 48.180000 54.085938 19.630000 23.789062 203.57s FLOAT_8_E4 89.800000 90.562500 48.230000 38.992188 19.730000 22.078125 160.13s
FLOAT_8_E5 89.560000 98.187500 48.020000 54.031250 21.520000 33.882812 203.36s FLOAT_8_E5 89.560000 88.507812 48.200000 35.367188 21.490000 20.648438 161.57s
FLOAT_8_E6 87.870000 97.664062 45.340000 51.070312 22.850000 32.656250 203.67s FLOAT_8_E6 87.880000 87.609375 45.400000 33.148438 22.670000 21.898438 162.22s
AlexNet cifar10 AlexNet cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 88.640000 98.367188 45.350000 44.460938 19.840000 18.523438 12.74s Full 88.640000 95.859375 45.340000 48.312500 19.870000 19.773438 11.55s
INT_2 10.000000 9.664062 10.000000 9.664062 10.000000 9.664062 25.70s INT_2 10.000000 9.882812 10.000000 9.882812 10.000000 9.882812 26.12s
INT_3 10.120000 11.695312 10.000000 9.734375 10.000000 9.734375 26.12s INT_3 10.120000 9.585938 10.000000 9.828125 10.000000 9.828125 28.13s
INT_4 55.630000 32.539062 14.140000 15.945312 11.180000 12.492188 26.08s INT_4 55.760000 21.328125 14.210000 12.359375 11.580000 10.000000 28.33s
INT_5 82.870000 91.015625 38.720000 39.273438 29.440000 32.289062 27.52s INT_5 82.890000 75.414062 37.630000 37.070312 28.830000 30.320312 27.25s
INT_6 87.290000 96.789062 43.940000 42.273438 30.270000 30.421875 26.53s INT_6 87.300000 89.273438 44.030000 45.296875 30.470000 33.867188 28.50s
INT_7 88.210000 98.171875 44.080000 45.671875 25.950000 25.851562 27.96s INT_7 88.230000 92.593750 44.110000 48.296875 26.070000 29.820312 27.30s
INT_8 88.450000 98.320312 45.320000 45.484375 23.240000 21.710938 26.62s INT_8 88.420000 95.539062 45.360000 49.085938 23.120000 24.617188 26.47s
INT_9 88.620000 98.382812 45.110000 44.523438 21.210000 19.460938 28.96s INT_9 88.570000 95.515625 45.290000 48.234375 21.130000 21.718750 29.46s
INT_10 88.700000 98.382812 45.330000 44.515625 20.510000 19.023438 27.46s INT_10 88.690000 95.695312 45.350000 48.578125 20.470000 20.601562 30.35s
INT_11 88.660000 98.351562 45.370000 44.546875 20.060000 18.617188 28.68s INT_11 88.670000 95.773438 45.480000 48.492188 20.190000 19.968750 23.86s
INT_12 88.650000 98.367188 45.280000 44.601562 19.970000 18.515625 28.58s INT_12 88.650000 95.820312 45.260000 48.203125 19.960000 19.843750 29.32s
INT_13 88.610000 98.359375 45.300000 44.445312 19.930000 18.539062 28.37s INT_13 88.620000 95.835938 45.320000 48.273438 19.860000 19.718750 21.08s
INT_14 88.630000 98.367188 45.280000 44.390625 19.850000 18.515625 28.09s INT_14 88.650000 95.851562 45.260000 48.296875 19.810000 19.781250 20.28s
INT_15 88.620000 98.375000 45.340000 44.437500 19.920000 18.484375 27.94s INT_15 88.620000 95.859375 45.300000 48.343750 19.880000 19.820312 21.88s
INT_16 88.640000 98.359375 45.360000 44.453125 19.860000 18.500000 29.81s INT_16 88.630000 95.867188 45.350000 48.343750 19.870000 19.742188 20.06s
POT_2 10.000000 9.664062 10.000000 9.664062 10.000000 9.664062 38.80s POT_2 10.000000 9.882812 10.000000 9.882812 10.000000 9.882812 34.26s
POT_3 16.660000 22.265625 10.000000 9.734375 10.000000 9.734375 39.44s POT_3 16.660000 11.054688 10.010000 9.828125 10.010000 9.828125 35.33s
POT_4 69.820000 80.359375 28.350000 21.015625 17.140000 16.023438 44.81s POT_4 69.720000 72.195312 27.940000 22.312500 17.210000 16.585938 36.98s
POT_5 69.760000 81.335938 27.910000 20.648438 15.550000 15.398438 54.06s POT_5 69.820000 72.960938 27.650000 21.328125 15.360000 15.257812 44.30s
POT_6 70.700000 82.140625 27.860000 20.617188 15.480000 15.296875 75.89s POT_6 70.690000 72.507812 27.950000 21.875000 15.300000 15.398438 61.61s
POT_7 70.330000 81.703125 27.980000 20.531250 15.410000 15.296875 118.40s POT_7 70.350000 72.914062 27.880000 21.367188 15.550000 15.148438 93.04s
POT_8 69.780000 81.601562 27.390000 20.640625 15.190000 15.539062 202.54s POT_8 69.880000 73.070312 27.670000 21.289062 15.590000 15.109375 159.20s
FLOAT_3_E1 23.290000 23.593750 14.870000 17.546875 12.380000 13.703125 38.63s FLOAT_3_E1 23.040000 23.671875 14.810000 19.656250 12.180000 15.976562 30.31s
FLOAT_4_E1 68.090000 78.453125 23.870000 25.351562 17.530000 19.164062 45.01s FLOAT_4_E1 68.130000 66.664062 24.490000 28.875000 17.330000 22.562500 36.84s
FLOAT_4_E2 66.380000 64.734375 24.690000 28.187500 20.490000 24.898438 44.96s FLOAT_4_E2 66.690000 41.289062 24.390000 22.781250 20.260000 20.023438 37.31s
FLOAT_5_E1 79.440000 91.828125 28.910000 34.781250 18.920000 23.375000 54.94s FLOAT_5_E1 79.460000 82.484375 28.880000 32.195312 18.880000 22.320312 44.82s
FLOAT_5_E2 84.040000 90.421875 38.090000 39.320312 23.950000 24.382812 54.86s FLOAT_5_E2 83.980000 78.796875 38.050000 38.343750 24.160000 25.937500 44.75s
FLOAT_5_E3 85.010000 96.132812 39.170000 42.804688 19.610000 21.914062 54.40s FLOAT_5_E3 84.950000 89.390625 39.050000 38.515625 19.540000 20.539062 43.53s
FLOAT_6_E1 83.300000 92.437500 33.340000 48.632812 18.750000 28.976562 76.28s FLOAT_6_E1 83.310000 87.921875 33.350000 43.343750 18.760000 25.039062 58.19s
FLOAT_6_E2 87.160000 95.906250 40.520000 36.976562 21.800000 19.195312 76.35s FLOAT_6_E2 87.120000 88.531250 40.590000 37.906250 21.890000 21.085938 58.11s
FLOAT_6_E3 88.000000 98.132812 44.240000 46.445312 20.020000 18.070312 75.01s FLOAT_6_E3 87.990000 93.718750 44.360000 48.609375 20.210000 20.351562 57.93s
FLOAT_6_E4 85.260000 96.414062 39.190000 42.765625 19.890000 21.921875 76.13s FLOAT_6_E4 85.210000 89.656250 39.180000 37.476562 19.930000 19.718750 58.23s
FLOAT_7_E1 85.010000 94.062500 35.230000 57.640625 17.780000 35.171875 118.51s FLOAT_7_E1 85.030000 88.312500 35.140000 47.812500 18.060000 25.906250 91.86s
FLOAT_7_E2 87.530000 96.648438 41.790000 33.414062 20.990000 15.617188 119.42s FLOAT_7_E2 87.540000 91.695312 41.970000 37.226562 20.980000 17.679688 94.28s
FLOAT_7_E3 88.620000 98.375000 44.910000 45.765625 19.990000 19.265625 118.86s FLOAT_7_E3 88.650000 95.453125 44.930000 48.140625 20.010000 21.007812 94.63s
FLOAT_7_E4 88.100000 98.046875 44.130000 46.031250 19.990000 18.000000 118.58s FLOAT_7_E4 88.110000 93.734375 44.070000 48.078125 20.130000 20.195312 93.68s
FLOAT_7_E5 85.250000 96.125000 39.210000 42.187500 19.480000 21.625000 119.04s FLOAT_7_E5 85.230000 89.429688 39.150000 37.304688 19.880000 19.429688 94.21s
FLOAT_8_E1 86.050000 95.023438 36.430000 57.023438 17.670000 33.640625 202.68s FLOAT_8_E1 86.080000 89.343750 36.570000 48.812500 17.650000 24.742188 160.78s
FLOAT_8_E2 87.840000 96.796875 42.310000 31.882812 19.590000 14.875000 202.56s FLOAT_8_E2 87.870000 92.304688 42.340000 35.843750 19.240000 16.101562 160.98s
FLOAT_8_E3 88.720000 98.507812 44.790000 45.359375 19.850000 18.406250 203.11s FLOAT_8_E3 88.700000 95.898438 44.780000 48.742188 19.900000 20.609375 159.82s
FLOAT_8_E4 88.620000 98.343750 44.770000 45.515625 20.090000 19.156250 203.37s FLOAT_8_E4 88.620000 95.226562 44.780000 47.507812 19.930000 20.953125 159.36s
FLOAT_8_E5 88.150000 98.187500 44.180000 45.843750 20.120000 18.125000 203.58s FLOAT_8_E5 88.210000 93.773438 44.070000 48.421875 20.090000 20.195312 159.44s
FLOAT_8_E6 85.170000 96.140625 38.670000 42.554688 19.550000 21.828125 203.49s FLOAT_8_E6 85.220000 89.656250 38.670000 37.437500 19.480000 19.765625 159.55s
Inception_BN cifar10 Inception_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.830000 99.976562 42.840000 61.320312 7.240000 4.601562 158.12s Full 94.840000 100.000000 42.780000 68.640625 7.230000 12.726562 159.12s
INT_2 10.000000 10.039062 10.000000 10.039062 10.000000 10.039062 289.91s INT_2 10.000000 9.695312 10.000000 9.695312 10.000000 9.695312 314.70s
INT_3 10.680000 11.445312 10.090000 9.281250 10.320000 9.921875 286.58s INT_3 11.190000 10.789062 9.860000 11.015625 9.250000 10.351562 282.15s
INT_4 29.840000 34.031250 13.340000 25.953125 11.530000 23.289062 309.70s INT_4 30.290000 56.968750 10.690000 22.523438 10.230000 23.835938 303.39s
INT_5 80.350000 87.601562 31.260000 43.593750 16.150000 26.859375 310.38s INT_5 80.740000 99.078125 27.880000 52.000000 14.870000 33.976562 313.97s
INT_6 93.480000 99.765625 41.320000 58.539062 12.690000 23.078125 314.44s INT_6 93.410000 100.000000 41.890000 58.882812 13.820000 27.445312 311.68s
INT_7 94.540000 99.976562 42.930000 61.117188 9.610000 11.625000 313.02s INT_7 94.470000 100.000000 44.490000 65.687500 10.510000 18.789062 310.58s
INT_8 94.830000 99.976562 43.680000 61.593750 8.100000 6.328125 311.08s INT_8 94.830000 100.000000 43.240000 68.648438 8.650000 14.890625 320.47s
INT_9 94.840000 99.960938 43.210000 60.367188 7.430000 4.828125 309.57s INT_9 94.770000 100.000000 42.900000 68.359375 7.640000 13.453125 317.92s
INT_10 94.790000 99.968750 42.950000 60.304688 7.220000 4.656250 305.39s INT_10 94.840000 100.000000 42.770000 68.109375 7.390000 12.953125 283.89s
INT_11 94.840000 99.968750 42.830000 60.445312 7.210000 4.523438 308.33s INT_11 94.830000 100.000000 42.900000 68.460938 7.180000 12.898438 302.49s
INT_12 94.850000 99.968750 42.900000 60.382812 7.230000 4.507812 313.92s INT_12 94.870000 100.000000 42.760000 68.335938 7.250000 12.843750 325.46s
INT_13 94.820000 99.968750 42.740000 60.468750 7.250000 4.515625 292.75s INT_13 94.840000 100.000000 42.690000 68.390625 7.200000 12.882812 312.06s
INT_14 94.830000 99.968750 42.790000 60.414062 7.060000 4.531250 309.78s INT_14 94.840000 100.000000 42.730000 68.492188 7.160000 12.843750 318.80s
INT_15 94.810000 99.968750 42.850000 60.398438 7.250000 4.523438 309.29s INT_15 94.830000 100.000000 42.860000 68.414062 7.160000 12.882812 317.39s
INT_16 94.830000 99.968750 42.800000 60.445312 7.200000 4.492188 307.34s INT_16 94.830000 100.000000 42.970000 68.460938 7.150000 12.804688 311.29s
POT_2 10.000000 10.039062 10.000000 10.039062 10.000000 10.039062 449.54s POT_2 10.000000 9.695312 10.000000 9.695312 10.000000 9.695312 440.67s
POT_3 11.500000 8.343750 9.780000 9.632812 9.630000 9.210938 502.14s POT_3 11.710000 11.796875 10.220000 10.632812 9.910000 10.257812 499.91s
POT_4 38.810000 24.929688 14.590000 15.445312 10.510000 13.671875 639.36s POT_4 39.190000 86.203125 25.300000 39.031250 18.300000 24.617188 638.73s
POT_5 40.190000 39.179688 16.720000 26.164062 13.180000 21.125000 909.17s POT_5 39.970000 58.414062 17.850000 15.835938 11.930000 10.156250 903.95s
POT_6 23.960000 24.367188 13.880000 16.445312 9.070000 13.445312 1425.79s POT_6 24.110000 39.843750 16.870000 13.609375 11.480000 9.406250 1419.10s
POT_7 38.480000 48.031250 18.230000 26.125000 10.690000 18.312500 2487.01s POT_7 38.160000 69.351562 18.800000 15.687500 13.000000 14.617188 2479.35s
POT_8 40.730000 42.921875 19.370000 23.312500 12.090000 14.000000 4562.34s POT_8 42.380000 71.687500 20.860000 19.179688 12.220000 11.484375 4553.80s
FLOAT_3_E1 10.000000 9.890625 9.910000 9.218750 10.140000 9.398438 503.88s FLOAT_3_E1 10.070000 9.921875 10.000000 9.921875 10.010000 9.929688 498.83s
FLOAT_4_E1 19.150000 30.679688 20.670000 15.750000 14.380000 12.265625 640.31s FLOAT_4_E1 17.330000 43.562500 22.010000 16.273438 13.050000 14.789062 638.79s
FLOAT_4_E2 54.380000 44.984375 16.450000 25.640625 10.530000 16.679688 640.48s FLOAT_4_E2 54.070000 85.593750 16.550000 30.296875 10.690000 20.828125 639.04s
FLOAT_5_E1 60.290000 76.406250 28.360000 38.593750 15.290000 22.578125 906.06s FLOAT_5_E1 59.350000 93.437500 28.440000 46.585938 15.050000 32.585938 903.64s
FLOAT_5_E2 85.500000 98.218750 37.320000 39.484375 17.170000 17.351562 906.78s FLOAT_5_E2 85.420000 99.882812 32.640000 41.015625 16.570000 18.460938 903.75s
FLOAT_5_E3 86.480000 99.593750 40.220000 59.359375 13.480000 26.515625 907.52s FLOAT_5_E3 86.560000 99.812500 37.710000 52.234375 15.170000 28.453125 904.53s
FLOAT_6_E1 76.320000 95.289062 30.400000 43.734375 12.730000 19.054688 1420.68s FLOAT_6_E1 76.170000 99.468750 31.270000 48.234375 12.900000 24.906250 1416.71s
FLOAT_6_E2 92.260000 99.859375 40.440000 46.671875 14.370000 13.015625 1424.48s FLOAT_6_E2 92.320000 99.984375 41.310000 66.632812 15.030000 29.210938 1417.22s
FLOAT_6_E3 93.400000 99.929688 43.200000 62.179688 11.020000 16.570312 1426.48s FLOAT_6_E3 93.410000 100.000000 42.730000 60.562500 10.920000 19.085938 1419.16s
FLOAT_6_E4 86.480000 99.500000 38.810000 51.578125 14.470000 22.687500 1422.52s FLOAT_6_E4 86.650000 99.968750 39.640000 62.695312 13.870000 33.812500 1420.92s
FLOAT_7_E1 78.170000 97.359375 31.890000 42.812500 11.760000 14.968750 2480.58s FLOAT_7_E1 78.420000 99.882812 31.710000 50.265625 11.920000 21.695312 2478.14s
FLOAT_7_E2 93.010000 99.914062 42.120000 46.851562 13.230000 9.828125 2480.65s FLOAT_7_E2 93.160000 99.992188 41.380000 59.921875 13.400000 17.835938 2478.68s
FLOAT_7_E3 94.470000 99.976562 43.230000 57.070312 8.860000 6.117188 2485.42s FLOAT_7_E3 94.420000 100.000000 43.700000 70.140625 9.330000 16.039062 2480.34s
FLOAT_7_E4 93.430000 99.953125 42.890000 63.476562 11.410000 17.773438 2486.79s FLOAT_7_E4 93.390000 100.000000 42.990000 65.554688 11.060000 21.835938 2480.62s
FLOAT_7_E5 87.980000 98.765625 38.120000 51.718750 14.820000 25.601562 2484.98s FLOAT_7_E5 88.260000 99.960938 38.530000 62.062500 13.230000 31.546875 2480.32s
FLOAT_8_E1 82.480000 99.859375 32.290000 51.734375 10.870000 20.750000 4552.20s
FLOAT_8_E2 93.720000 99.992188 41.040000 61.976562 11.850000 18.085938 4553.95s
FLOAT_8_E3 94.800000 100.000000 42.930000 68.507812 8.000000 13.492188 4557.31s
FLOAT_8_E4 94.500000 100.000000 43.290000 69.257812 9.050000 16.257812 4561.96s
FLOAT_8_E5 93.220000 100.000000 42.310000 60.828125 11.090000 19.515625 4561.87s
FLOAT_8_E6 87.720000 99.750000 37.610000 56.781250 14.090000 31.648438 4562.20s
Inception_BN cifar10 Inception_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.830000 88.007812 42.810000 46.429688 7.230000 5.210938 157.45s Full 94.840000 95.078125 42.750000 41.726562 7.220000 7.421875 230.02s
INT_2 10.000000 9.539062 10.000000 9.539062 10.000000 9.539062 312.83s INT_2 10.000000 9.718750 10.000000 9.718750 10.000000 9.718750 365.64s
INT_3 10.750000 7.906250 9.430000 10.664062 9.670000 9.742188 273.20s INT_3 10.460000 10.273438 10.850000 9.429688 10.340000 9.242188 365.24s
INT_4 29.690000 28.929688 14.540000 19.476562 10.040000 15.421875 327.39s INT_4 29.940000 17.429688 14.270000 13.875000 10.530000 14.945312 368.69s
INT_5 80.670000 59.156250 30.230000 29.742188 16.490000 18.468750 326.41s INT_5 80.500000 53.632812 33.510000 35.109375 16.580000 25.281250 370.48s
INT_6 93.540000 79.750000 42.680000 40.429688 13.360000 15.554688 313.06s INT_6 93.450000 86.859375 42.360000 35.437500 12.250000 14.976562 370.84s
INT_7 94.510000 86.109375 42.520000 45.703125 9.560000 10.015625 321.22s INT_7 94.570000 94.789062 44.270000 38.632812 10.020000 9.875000 368.34s
INT_8 94.860000 86.617188 43.170000 45.945312 8.010000 5.648438 317.96s INT_8 94.810000 94.781250 43.320000 40.656250 8.130000 7.984375 369.72s
INT_9 94.810000 85.437500 43.200000 45.750000 7.580000 5.710938 326.22s INT_9 94.880000 94.226562 42.990000 40.382812 7.470000 7.679688 368.32s
INT_10 94.840000 85.554688 42.920000 45.273438 7.240000 5.296875 308.54s INT_10 94.810000 94.242188 42.920000 40.664062 7.290000 7.515625 370.66s
INT_11 94.840000 85.335938 42.870000 45.500000 7.360000 5.328125 308.32s INT_11 94.840000 94.375000 42.810000 40.773438 7.170000 7.289062 368.69s
INT_12 94.850000 85.539062 42.750000 45.359375 7.230000 5.234375 319.09s INT_12 94.850000 94.304688 42.700000 40.703125 7.190000 7.187500 366.69s
INT_13 94.820000 85.296875 42.870000 45.484375 7.120000 5.171875 313.66s INT_13 94.840000 94.328125 42.810000 40.648438 7.320000 7.164062 364.85s
INT_14 94.840000 85.359375 42.820000 45.460938 7.210000 5.164062 308.37s INT_14 94.830000 94.289062 42.890000 40.648438 7.250000 7.210938 366.21s
INT_15 94.810000 85.585938 42.770000 45.515625 7.200000 5.226562 309.83s INT_15 94.800000 94.289062 42.800000 40.640625 7.200000 7.242188 370.93s
INT_16 94.830000 85.632812 42.780000 45.523438 7.270000 5.210938 312.72s INT_16 94.830000 94.289062 42.870000 40.562500 7.130000 7.281250 370.24s
POT_2 10.000000 9.539062 10.000000 9.539062 10.000000 9.539062 442.95s POT_2 10.000000 9.718750 10.000000 9.718750 10.000000 9.718750 601.08s
POT_3 11.540000 10.664062 10.350000 9.187500 10.290000 9.710938 500.26s POT_3 11.430000 10.703125 10.650000 10.195312 10.320000 10.109375 686.37s
POT_4 38.340000 21.226562 26.370000 22.453125 16.150000 11.648438 639.03s POT_4 39.230000 24.710938 21.770000 19.046875 14.730000 17.929688 858.71s
POT_5 39.980000 34.382812 17.060000 16.164062 11.520000 11.773438 908.58s POT_5 40.290000 29.742188 22.820000 23.421875 15.940000 21.726562 1196.08s
POT_6 24.030000 15.484375 13.480000 11.171875 9.170000 10.406250 1426.20s POT_6 24.020000 17.906250 22.950000 27.687500 16.360000 25.210938 1856.77s
POT_7 38.250000 40.664062 22.170000 20.437500 15.010000 9.546875 2483.35s POT_7 38.760000 30.343750 19.840000 15.718750 11.280000 14.492188 3214.18s
POT_8 41.360000 32.523438 23.510000 20.164062 14.980000 12.617188 4567.44s POT_8 41.310000 32.125000 23.470000 21.703125 14.200000 15.023438 5820.29s
FLOAT_3_E1 10.030000 9.968750 9.950000 9.984375 10.060000 10.132812 503.42s FLOAT_3_E1 10.010000 9.718750 10.000000 9.718750 10.000000 9.718750 686.32s
FLOAT_4_E1 17.620000 28.054688 19.260000 16.750000 14.870000 11.382812 639.87s FLOAT_4_E1 19.030000 14.632812 16.200000 13.937500 11.540000 11.453125 857.40s
FLOAT_4_E2 54.990000 26.539062 16.470000 19.804688 10.100000 9.843750 640.43s FLOAT_4_E2 54.370000 39.140625 23.220000 24.398438 13.690000 18.921875 857.03s
FLOAT_5_E1 59.920000 48.804688 28.060000 29.125000 14.400000 19.906250 905.43s FLOAT_5_E1 59.600000 45.625000 25.810000 28.820312 12.370000 15.562500 1193.96s
FLOAT_5_E2 85.410000 71.265625 33.910000 26.796875 16.600000 12.984375 910.60s FLOAT_5_E2 85.590000 76.921875 35.130000 25.570312 16.800000 7.625000 1194.17s
FLOAT_5_E3 86.580000 72.437500 37.810000 41.031250 13.790000 18.593750 903.49s FLOAT_5_E3 86.340000 86.984375 37.470000 42.226562 13.490000 18.960938 1194.70s
FLOAT_6_E1 76.300000 58.875000 30.310000 32.015625 12.410000 15.710938 1420.05s FLOAT_6_E1 76.000000 60.804688 28.930000 34.359375 12.270000 18.390625 1855.91s
FLOAT_6_E2 92.190000 88.070312 41.010000 36.132812 14.840000 9.726562 1419.32s FLOAT_6_E2 92.410000 90.937500 40.040000 32.726562 12.790000 12.062500 1855.39s
FLOAT_6_E3 93.290000 86.539062 42.810000 42.671875 11.900000 12.796875 1422.39s FLOAT_6_E3 93.250000 90.656250 42.860000 35.531250 11.750000 9.101562 1855.62s
FLOAT_6_E4 86.740000 78.867188 39.560000 44.601562 14.680000 18.531250 1421.04s FLOAT_6_E4 86.730000 80.906250 37.080000 40.640625 13.500000 19.031250 1855.54s
FLOAT_7_E1 78.370000 58.156250 30.890000 33.570312 11.620000 14.000000 2480.21s FLOAT_7_E1 78.430000 62.835938 30.440000 37.726562 11.450000 18.687500 3214.38s
FLOAT_7_E2 93.030000 88.695312 42.090000 39.156250 13.060000 9.492188 2483.90s FLOAT_7_E2 93.020000 92.054688 41.280000 32.671875 12.670000 9.757812 3214.59s
FLOAT_7_E3 94.450000 88.250000 43.370000 43.000000 9.310000 6.257812 2482.01s FLOAT_7_E3 94.450000 93.835938 43.580000 40.140625 8.820000 11.117188 3214.45s
FLOAT_7_E4 93.570000 85.632812 43.480000 43.718750 11.540000 13.203125 2481.06s FLOAT_7_E4 93.420000 93.171875 43.820000 37.226562 11.210000 6.117188 3214.26s
FLOAT_7_E5 88.000000 68.929688 39.650000 41.398438 14.730000 17.562500 2482.61s FLOAT_7_E5 88.060000 81.570312 35.870000 35.132812 13.490000 16.367188 3214.75s
FLOAT_8_E1 82.240000 61.664062 31.650000 31.703125 10.610000 12.351562 4562.81s FLOAT_8_E1 82.340000 69.906250 31.490000 37.898438 11.270000 18.218750 5820.11s
FLOAT_8_E2 93.680000 86.945312 41.010000 35.921875 12.320000 8.031250 4563.76s FLOAT_8_E2 93.760000 92.195312 41.640000 33.476562 10.810000 9.507812 5820.63s
FLOAT_8_E3 94.760000 86.843750 42.640000 45.796875 7.780000 5.781250 4562.76s FLOAT_8_E3 94.740000 94.265625 42.360000 40.679688 7.700000 8.460938 5820.00s
FLOAT_8_E4 94.460000 88.773438 43.660000 41.367188 9.330000 5.921875 4575.23s FLOAT_8_E4 94.450000 93.929688 43.420000 39.671875 8.920000 11.015625 5820.34s
FLOAT_8_E5 93.290000 86.468750 41.740000 41.054688 11.830000 11.843750 4576.43s FLOAT_8_E5 93.160000 90.007812 42.760000 35.765625 11.030000 5.992188 5820.05s
FLOAT_8_E6 87.980000 77.648438 37.900000 42.898438 14.720000 18.507812 4572.51s
MobileNetV2 cifar10 MobileNetV2 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.270000 99.960938 40.190000 76.007812 5.550000 16.015625 58.61s Full 90.260000 99.945312 40.210000 83.195312 5.610000 16.906250 60.46s
INT_2 10.000000 9.453125 10.000000 9.453125 10.000000 9.453125 228.33s INT_2 10.000000 9.765625 10.000000 9.765625 10.000000 9.765625 221.87s
INT_3 9.960000 9.453125 10.000000 9.453125 10.000000 9.453125 225.76s INT_3 9.960000 9.765625 10.000000 9.765625 10.000000 9.765625 222.28s
INT_4 9.490000 10.398438 10.280000 9.835938 10.150000 9.960938 229.86s INT_4 9.460000 11.250000 10.040000 10.023438 9.710000 9.429688 220.40s
INT_5 20.560000 38.156250 11.720000 18.320312 10.230000 14.906250 229.48s INT_5 20.380000 43.203125 12.340000 19.960938 10.820000 16.460938 162.90s
INT_6 57.910000 94.695312 24.450000 39.335938 14.740000 25.492188 229.98s INT_6 57.930000 94.695312 20.010000 53.164062 12.600000 34.671875 222.45s
INT_7 80.300000 99.617188 35.160000 64.382812 12.750000 33.750000 228.65s INT_7 80.090000 99.617188 35.750000 70.015625 13.600000 35.195312 222.45s
INT_8 88.180000 99.898438 43.090000 76.250000 10.770000 28.632812 228.98s INT_8 88.220000 99.953125 43.040000 82.398438 10.670000 32.046875 219.99s
INT_9 89.760000 99.937500 41.570000 74.953125 8.410000 21.726562 227.42s INT_9 89.870000 99.937500 41.590000 82.585938 8.130000 23.070312 218.91s
INT_10 90.380000 99.968750 40.400000 75.234375 6.480000 18.093750 204.56s INT_10 90.290000 99.937500 40.530000 83.265625 6.360000 18.984375 146.57s
INT_11 90.290000 99.945312 40.410000 76.359375 5.950000 17.062500 230.18s INT_11 90.290000 99.937500 40.340000 83.453125 6.010000 17.742188 140.19s
INT_12 90.270000 99.960938 40.260000 75.882812 5.750000 16.234375 228.24s INT_12 90.230000 99.945312 40.320000 83.054688 5.690000 17.085938 219.15s
INT_13 90.240000 99.960938 40.270000 76.000000 5.760000 16.195312 184.42s INT_13 90.260000 99.945312 40.270000 83.265625 5.640000 16.968750 223.43s
INT_14 90.260000 99.960938 40.140000 75.937500 5.610000 16.101562 231.10s INT_14 90.280000 99.945312 40.130000 83.226562 5.680000 16.960938 221.80s
INT_15 90.270000 99.960938 40.220000 76.000000 5.660000 16.085938 230.59s INT_15 90.270000 99.945312 40.170000 83.171875 5.600000 16.835938 222.38s
INT_16 90.270000 99.960938 40.100000 76.117188 5.650000 16.085938 226.82s INT_16 90.250000 99.945312 40.260000 83.156250 5.570000 16.945312 221.94s
POT_2 10.000000 9.453125 10.000000 9.453125 10.000000 9.453125 249.26s POT_2 10.000000 9.765625 10.000000 9.765625 10.000000 9.765625 249.32s
POT_3 9.990000 9.343750 9.790000 9.484375 9.910000 9.453125 253.89s POT_3 9.990000 8.921875 9.700000 9.781250 9.840000 9.765625 247.80s
POT_4 14.620000 21.656250 10.240000 14.851562 10.260000 14.046875 267.65s POT_4 14.520000 23.109375 10.230000 10.882812 10.210000 11.210938 262.58s
POT_5 14.390000 20.992188 10.700000 12.523438 10.550000 9.789062 314.54s POT_5 14.230000 22.585938 10.910000 12.890625 10.650000 11.679688 322.25s
POT_6 14.330000 20.406250 10.030000 11.757812 10.020000 11.039062 446.22s POT_6 14.130000 22.289062 10.030000 9.781250 10.030000 9.359375 440.23s
POT_7 15.040000 22.085938 10.510000 15.671875 10.100000 12.734375 688.91s POT_7 15.140000 26.625000 10.380000 12.796875 10.250000 9.718750 688.71s
POT_8 14.710000 20.492188 11.000000 12.359375 10.430000 11.156250 1190.58s POT_8 15.060000 24.000000 11.000000 14.476562 10.420000 10.421875 1181.86s
FLOAT_3_E1 9.660000 9.859375 9.960000 10.007812 9.920000 10.117188 222.21s FLOAT_3_E1 9.660000 10.148438 10.060000 10.125000 10.000000 10.125000 249.52s
FLOAT_4_E1 11.660000 13.765625 10.170000 10.539062 11.100000 10.703125 269.14s FLOAT_4_E1 11.660000 12.671875 13.910000 10.460938 12.840000 10.265625 263.09s
FLOAT_4_E2 13.230000 19.789062 10.430000 13.820312 10.080000 13.921875 269.10s FLOAT_4_E2 14.050000 26.601562 11.760000 11.007812 10.650000 11.000000 262.63s
FLOAT_5_E1 17.160000 32.843750 11.100000 21.820312 10.590000 19.171875 320.41s FLOAT_5_E1 20.310000 34.726562 12.360000 23.187500 11.220000 20.156250 324.11s
FLOAT_5_E2 26.760000 49.726562 14.300000 24.031250 11.460000 21.664062 316.64s FLOAT_5_E2 26.860000 54.476562 14.650000 27.117188 11.540000 20.671875 322.74s
FLOAT_5_E3 46.320000 76.359375 28.230000 38.593750 15.810000 27.125000 325.47s FLOAT_5_E3 45.920000 82.156250 20.140000 43.734375 13.010000 28.398438 321.91s
FLOAT_6_E1 28.010000 48.945312 11.350000 28.734375 10.320000 25.109375 445.64s FLOAT_6_E1 28.220000 56.562500 11.900000 25.828125 10.270000 18.156250 441.12s
FLOAT_6_E2 45.820000 88.882812 21.670000 25.640625 13.820000 20.078125 445.42s FLOAT_6_E2 45.760000 91.429688 23.430000 34.835938 13.510000 22.921875 429.02s
FLOAT_6_E3 69.910000 97.281250 37.480000 64.585938 13.410000 35.734375 444.29s FLOAT_6_E3 69.700000 98.257812 36.610000 72.695312 14.170000 40.140625 416.46s
FLOAT_6_E4 46.590000 77.820312 27.800000 37.906250 15.840000 25.828125 444.06s FLOAT_6_E4 47.240000 83.187500 18.660000 41.070312 11.350000 25.710938 416.64s
FLOAT_7_E1 33.850000 65.789062 12.760000 12.945312 9.460000 10.710938 695.39s FLOAT_7_E1 33.610000 79.367188 13.020000 16.882812 9.480000 11.164062 672.43s
FLOAT_7_E2 59.400000 95.421875 21.080000 24.164062 9.980000 16.007812 675.21s FLOAT_7_E2 59.640000 95.125000 23.150000 32.382812 10.840000 16.445312 690.92s
FLOAT_7_E3 85.620000 99.906250 38.860000 71.718750 11.040000 29.531250 682.41s FLOAT_7_E3 85.470000 99.921875 37.040000 76.406250 10.220000 30.867188 688.60s
FLOAT_7_E4 68.900000 97.562500 36.920000 63.671875 13.480000 34.007812 676.20s FLOAT_7_E4 68.700000 98.078125 37.060000 72.914062 14.400000 40.304688 688.90s
FLOAT_7_E5 47.350000 76.328125 23.630000 37.179688 13.530000 25.382812 689.76s FLOAT_7_E5 46.970000 81.351562 22.650000 39.742188 13.130000 24.273438 669.48s
FLOAT_8_E1 41.420000 72.015625 11.360000 22.734375 10.010000 15.734375 1184.54s FLOAT_8_E1 41.330000 82.734375 13.990000 25.460938 10.790000 15.929688 1180.58s
FLOAT_8_E2 68.860000 97.851562 24.470000 32.976562 11.570000 21.460938 1189.14s FLOAT_8_E2 68.280000 98.757812 25.040000 42.312500 12.410000 19.406250 1182.82s
FLOAT_8_E3 89.220000 99.960938 40.040000 71.375000 8.530000 22.945312 1193.14s FLOAT_8_E3 89.170000 99.929688 41.030000 82.109375 8.950000 26.492188 1185.14s
FLOAT_8_E4 85.830000 99.867188 37.180000 68.492188 10.300000 27.601562 1187.11s FLOAT_8_E4 85.650000 99.945312 37.470000 74.156250 10.840000 28.179688 1184.22s
FLOAT_8_E5 68.490000 97.140625 36.850000 63.984375 13.690000 35.257812 1192.24s FLOAT_8_E5 68.250000 98.070312 36.270000 72.203125 14.450000 40.757812 1183.20s
FLOAT_8_E6 46.620000 76.835938 27.690000 38.179688 15.320000 25.703125 1191.62s FLOAT_8_E6 46.760000 81.242188 20.270000 39.390625 12.620000 24.437500 1184.79s
MobileNetV2 cifar10 MobileNetV2 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.270000 75.890625 40.190000 36.140625 5.590000 3.234375 57.71s Full 90.270000 96.546875 40.200000 35.757812 5.570000 6.156250 59.75s
INT_2 10.000000 9.960938 10.000000 9.960938 10.000000 9.960938 140.67s INT_2 10.000000 9.984375 10.000000 9.984375 10.000000 9.984375 222.66s
INT_3 9.960000 9.960938 10.000000 9.960938 10.000000 9.960938 203.35s INT_3 9.960000 9.976562 10.000000 9.984375 10.000000 9.984375 160.20s
INT_4 9.490000 8.921875 10.470000 9.171875 10.220000 9.117188 221.97s INT_4 9.490000 9.203125 10.250000 9.671875 10.270000 9.500000 225.38s
INT_5 20.560000 21.453125 12.930000 13.609375 10.540000 13.062500 219.63s INT_5 20.560000 23.906250 12.900000 18.679688 10.490000 16.226562 139.84s
INT_6 57.910000 59.773438 23.630000 22.429688 14.120000 12.093750 223.85s INT_6 57.910000 77.890625 24.490000 24.210938 14.120000 16.656250 221.92s
INT_7 80.300000 70.710938 36.340000 31.156250 13.340000 12.796875 223.15s INT_7 80.300000 92.078125 34.980000 27.851562 12.670000 12.906250 223.33s
INT_8 88.180000 72.945312 42.470000 36.648438 10.800000 7.296875 222.42s INT_8 88.180000 96.367188 42.630000 38.640625 10.660000 11.578125 195.72s
INT_9 89.760000 76.039062 41.690000 35.085938 8.180000 4.953125 224.29s INT_9 89.760000 96.507812 41.500000 34.898438 8.190000 8.093750 140.61s
INT_10 90.380000 76.070312 40.280000 35.804688 6.340000 3.812500 220.84s INT_10 90.380000 96.632812 40.140000 35.218750 6.420000 6.648438 207.40s
INT_11 90.290000 75.656250 40.460000 36.070312 5.930000 3.484375 225.77s INT_11 90.290000 96.687500 40.350000 35.882812 5.920000 6.546875 224.36s
INT_12 90.270000 75.679688 40.280000 36.039062 5.750000 3.281250 221.15s INT_12 90.270000 96.546875 40.340000 35.804688 5.810000 6.273438 225.78s
INT_13 90.240000 75.804688 40.230000 36.039062 5.770000 3.203125 221.53s INT_13 90.240000 96.523438 40.330000 35.765625 5.660000 6.210938 226.06s
INT_14 90.260000 75.851562 40.170000 36.195312 5.660000 3.187500 222.13s INT_14 90.260000 96.570312 40.140000 35.781250 5.650000 6.203125 227.30s
INT_15 90.270000 75.882812 40.190000 36.039062 5.630000 3.218750 223.85s INT_15 90.270000 96.554688 40.130000 35.804688 5.610000 6.140625 225.23s
INT_16 90.270000 75.875000 40.150000 36.078125 5.580000 3.203125 222.96s INT_16 90.270000 96.546875 40.070000 35.828125 5.650000 6.132812 225.36s
POT_2 10.000000 9.960938 10.000000 9.960938 10.000000 9.960938 243.47s POT_2 10.000000 9.984375 10.000000 9.984375 10.000000 9.984375 246.35s
POT_3 9.990000 9.882812 9.670000 9.281250 9.610000 9.593750 240.64s POT_3 9.990000 9.742188 9.920000 9.960938 9.980000 10.000000 248.84s
POT_4 14.620000 12.492188 10.170000 16.406250 10.070000 15.171875 262.08s POT_4 14.620000 16.445312 10.280000 14.242188 10.080000 12.476562 264.89s
POT_5 14.390000 11.203125 10.610000 12.218750 10.590000 10.539062 317.48s POT_5 14.390000 16.210938 10.640000 10.695312 10.110000 10.101562 323.07s
POT_6 14.330000 12.171875 10.020000 12.226562 10.000000 10.890625 436.84s POT_6 14.330000 16.226562 10.020000 10.273438 10.010000 10.023438 440.81s
POT_7 15.040000 14.234375 10.490000 16.687500 10.250000 14.820312 690.31s POT_7 15.040000 16.296875 10.990000 12.671875 10.470000 11.875000 688.60s
POT_8 14.710000 12.039062 11.290000 12.656250 10.560000 11.804688 1186.04s POT_8 14.710000 17.390625 10.930000 12.164062 10.650000 9.796875 1177.88s
FLOAT_3_E1 9.660000 9.750000 10.420000 9.703125 10.340000 9.921875 238.90s FLOAT_3_E1 9.660000 9.679688 10.130000 10.062500 10.010000 10.242188 242.49s
FLOAT_4_E1 11.660000 11.148438 11.340000 9.953125 10.950000 8.992188 261.89s FLOAT_4_E1 11.660000 14.132812 11.660000 10.296875 10.800000 9.984375 243.27s
FLOAT_4_E2 13.230000 15.601562 11.040000 12.132812 10.780000 11.171875 264.80s FLOAT_4_E2 13.230000 18.500000 10.690000 11.117188 9.960000 10.453125 259.99s
FLOAT_5_E1 17.160000 14.484375 10.780000 13.296875 10.350000 12.828125 319.40s FLOAT_5_E1 17.160000 23.734375 10.960000 19.148438 10.510000 15.820312 319.46s
FLOAT_5_E2 26.760000 25.257812 14.530000 20.609375 11.370000 17.187500 322.91s FLOAT_5_E2 26.760000 29.070312 13.800000 20.890625 11.360000 17.929688 319.64s
FLOAT_5_E3 46.320000 35.921875 26.910000 18.406250 14.750000 11.726562 323.57s FLOAT_5_E3 46.320000 51.226562 27.030000 37.070312 14.800000 27.570312 319.72s
FLOAT_6_E1 28.010000 21.164062 11.670000 13.085938 10.670000 10.898438 441.74s FLOAT_6_E1 28.010000 38.617188 11.700000 17.390625 10.540000 13.703125 439.14s
FLOAT_6_E2 45.820000 50.187500 21.360000 21.625000 13.380000 15.359375 441.60s FLOAT_6_E2 45.820000 60.453125 20.650000 19.937500 13.530000 14.539062 439.23s
FLOAT_6_E3 69.910000 66.226562 37.160000 31.343750 13.500000 10.710938 419.23s FLOAT_6_E3 69.910000 86.750000 37.250000 40.570312 13.300000 19.007812 438.94s
FLOAT_6_E4 46.590000 35.015625 27.670000 18.195312 15.450000 10.656250 438.30s FLOAT_6_E4 46.590000 49.515625 27.500000 37.000000 15.760000 24.625000 438.82s
FLOAT_7_E1 33.850000 42.398438 12.750000 13.359375 9.600000 8.742188 672.35s FLOAT_7_E1 33.850000 52.531250 12.790000 12.984375 9.410000 9.406250 686.43s
FLOAT_7_E2 59.400000 57.781250 21.050000 16.929688 10.500000 10.140625 679.77s FLOAT_7_E2 59.400000 69.179688 19.810000 20.562500 10.270000 11.921875 687.33s
FLOAT_7_E3 85.620000 75.304688 39.370000 37.000000 10.910000 9.648438 679.33s FLOAT_7_E3 85.620000 96.359375 39.120000 39.421875 10.830000 14.976562 687.57s
FLOAT_7_E4 68.900000 65.718750 36.710000 30.421875 13.590000 10.265625 690.20s FLOAT_7_E4 68.900000 86.796875 36.800000 40.203125 13.200000 18.367188 678.10s
FLOAT_7_E5 47.350000 38.382812 24.230000 21.367188 13.760000 16.851562 668.22s FLOAT_7_E5 47.350000 57.054688 24.290000 34.609375 13.030000 22.296875 687.02s
FLOAT_8_E1 41.420000 42.039062 11.290000 18.187500 9.980000 11.757812 1183.25s FLOAT_8_E1 41.420000 56.773438 11.560000 18.515625 9.930000 12.398438 1177.93s
FLOAT_8_E2 68.860000 58.406250 25.150000 18.640625 11.960000 9.539062 1182.87s FLOAT_8_E2 68.860000 77.484375 25.180000 24.289062 12.230000 14.562500 1180.02s
FLOAT_8_E3 89.220000 75.000000 39.870000 33.851562 8.730000 6.867188 1185.24s FLOAT_8_E3 89.220000 95.984375 39.840000 33.218750 8.650000 8.851562 1178.86s
FLOAT_8_E4 85.830000 75.945312 37.480000 36.562500 10.440000 8.906250 1187.76s FLOAT_8_E4 85.830000 96.351562 37.220000 39.687500 10.400000 14.828125 1159.26s
FLOAT_8_E5 68.490000 65.054688 36.680000 30.789062 13.730000 10.367188 1180.14s FLOAT_8_E5 68.490000 86.460938 36.810000 41.351562 13.380000 18.625000 1179.59s
FLOAT_8_E6 46.620000 36.007812 27.130000 17.242188 15.720000 10.234375 1187.43s FLOAT_8_E6 46.620000 51.703125 27.400000 33.859375 15.690000 23.250000 1180.15s
ResNet_152 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.430000 99.976562 44.340000 61.812500 10.150000 14.906250 334.33s
INT_2 10.000000 9.742188 10.000000 9.742188 10.000000 9.742188 855.55s
INT_3 10.030000 10.007812 10.000000 9.546875 10.000000 9.546875 854.98s
INT_4 15.490000 19.570312 11.060000 10.593750 10.630000 10.281250 857.55s
INT_5 30.450000 49.593750 14.840000 35.265625 8.430000 22.992188 857.39s
INT_6 74.520000 96.421875 19.890000 56.500000 8.670000 26.265625 794.95s
INT_7 90.250000 99.945312 36.120000 73.140625 10.010000 27.484375 858.74s
INT_8 94.030000 99.984375 42.410000 61.140625 10.510000 16.617188 858.21s
INT_9 94.310000 99.976562 44.990000 62.085938 10.740000 14.992188 858.72s
INT_10 94.410000 99.984375 43.580000 60.695312 10.280000 14.593750 855.46s
INT_11 94.370000 99.976562 43.910000 60.718750 10.310000 14.601562 852.76s
INT_12 94.410000 99.976562 44.170000 61.359375 10.270000 14.859375 859.22s
INT_13 94.450000 99.976562 44.280000 61.726562 10.220000 14.859375 851.80s
INT_14 94.430000 99.976562 44.300000 61.828125 10.200000 14.843750 851.35s
INT_15 94.420000 99.976562 44.470000 61.757812 10.180000 14.898438 852.51s
INT_16 94.430000 99.976562 44.290000 61.812500 10.300000 14.820312 708.86s
POT_2 10.000000 9.742188 10.000000 9.742188 10.000000 9.742188 1213.34s
POT_3 10.010000 9.703125 10.000000 9.539062 10.000000 9.468750 1376.82s
POT_4 44.480000 70.789062 18.810000 19.031250 15.130000 14.703125 1777.25s
POT_5 43.300000 71.757812 18.080000 18.648438 13.710000 13.773438 2583.99s
POT_6 39.560000 64.406250 18.670000 13.906250 13.510000 10.570312 4180.37s
POT_7 34.210000 66.468750 17.560000 18.710938 12.660000 12.937500 7461.56s
POT_8 39.230000 66.093750 17.320000 13.789062 13.110000 11.234375 13860.59s
FLOAT_3_E1 9.970000 17.218750 10.000000 9.789062 10.000000 9.796875 1371.40s
FLOAT_4_E1 18.780000 29.937500 14.600000 17.664062 11.750000 16.234375 1760.54s
FLOAT_4_E2 19.630000 30.039062 13.890000 11.000000 12.330000 8.875000 1761.26s
FLOAT_5_E1 60.340000 94.062500 16.940000 51.765625 10.390000 31.851562 2568.00s
FLOAT_5_E2 73.280000 99.125000 27.390000 40.296875 15.950000 20.078125 2568.36s
FLOAT_5_E3 84.320000 99.601562 30.030000 63.007812 13.070000 33.390625 2569.40s
FLOAT_6_E1 87.500000 99.890625 37.660000 61.945312 15.840000 36.546875 4147.24s
FLOAT_6_E2 82.970000 99.289062 34.830000 34.484375 15.750000 15.265625 4150.12s
FLOAT_6_E3 91.090000 99.960938 36.510000 55.265625 12.190000 17.703125 4160.50s
ResNet_152 cifar10 ResNet_152 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.430000 82.945312 44.280000 40.617188 10.150000 11.281250 327.10s Full 94.430000 99.945312 44.320000 50.250000 10.170000 12.046875 347.66s
INT_2 10.000000 10.179688 10.000000 10.179688 10.000000 10.179688 837.44s INT_2 10.000000 10.203125 10.000000 10.203125 10.000000 10.203125 838.26s
INT_3 10.030000 15.242188 9.990000 10.992188 9.990000 10.914062 842.54s INT_3 10.030000 10.328125 10.000000 9.953125 10.000000 9.953125 840.41s
INT_4 15.610000 15.093750 8.960000 11.781250 9.210000 11.539062 845.09s INT_4 15.700000 12.742188 8.690000 12.351562 8.760000 10.718750 840.70s
INT_5 30.350000 11.750000 17.610000 10.328125 13.970000 10.304688 850.06s INT_5 30.450000 27.562500 14.030000 45.539062 10.980000 38.164062 841.63s
INT_6 74.440000 24.976562 17.420000 52.289062 7.250000 24.015625 847.64s INT_6 73.990000 83.250000 19.840000 64.148438 8.740000 29.421875 839.85s
INT_7 90.430000 58.632812 35.830000 51.773438 10.340000 14.453125 842.06s INT_7 90.450000 99.679688 35.170000 58.703125 9.800000 20.414062 841.44s
INT_8 94.060000 80.796875 41.780000 38.859375 11.150000 11.289062 839.31s INT_8 94.060000 99.835938 42.300000 47.125000 11.240000 13.906250 842.02s
INT_9 94.280000 82.921875 45.410000 39.656250 11.100000 11.148438 846.84s INT_9 94.310000 99.906250 45.730000 49.679688 11.020000 12.109375 842.40s
INT_10 94.450000 83.195312 43.900000 40.585938 10.420000 11.867188 837.70s INT_10 94.390000 99.945312 44.040000 49.312500 10.480000 11.898438 841.17s
INT_11 94.390000 83.273438 44.180000 40.460938 10.280000 11.273438 843.87s INT_11 94.400000 99.953125 43.880000 49.812500 10.170000 12.007812 841.43s
INT_12 94.410000 83.070312 44.240000 40.648438 10.150000 11.406250 839.62s INT_12 94.420000 99.945312 44.060000 49.921875 10.050000 12.054688 840.65s
INT_13 94.440000 82.968750 44.300000 40.492188 10.140000 11.210938 843.67s INT_13 94.440000 99.953125 44.270000 50.242188 10.250000 12.031250 838.94s
INT_14 94.430000 82.875000 44.460000 40.781250 10.240000 11.265625 838.38s INT_14 94.430000 99.945312 44.430000 50.312500 10.190000 12.070312 839.48s
INT_15 94.420000 82.914062 44.310000 40.679688 10.220000 11.312500 840.17s INT_15 94.420000 99.945312 44.420000 50.328125 10.210000 12.109375 839.55s
INT_16 94.430000 82.906250 44.390000 40.632812 10.180000 11.281250 839.31s INT_16 94.430000 99.945312 44.360000 50.250000 10.260000 12.070312 774.33s
POT_2 10.000000 10.179688 10.000000 10.179688 10.000000 10.179688 1220.44s POT_2 10.000000 10.203125 10.000000 10.203125 10.000000 10.203125 1179.93s
POT_3 10.010000 12.671875 10.390000 14.234375 10.420000 14.554688 1389.87s POT_3 10.010000 9.250000 9.970000 8.585938 9.990000 8.460938 1377.22s
POT_4 43.550000 32.453125 17.810000 21.554688 11.080000 16.914062 1775.54s POT_4 43.380000 52.796875 19.010000 19.593750 15.180000 16.851562 1780.86s
POT_5 43.000000 24.554688 17.400000 28.750000 11.100000 17.304688 2581.30s POT_5 43.760000 52.789062 19.320000 20.640625 14.090000 17.328125 2587.36s
POT_6 40.110000 34.664062 18.850000 22.343750 12.360000 17.015625 4165.48s POT_6 40.120000 52.429688 18.690000 21.656250 13.810000 17.398438 4167.72s
POT_7 34.390000 28.687500 19.560000 18.109375 13.220000 14.476562 7427.86s POT_7 34.800000 51.281250 18.110000 19.640625 13.040000 14.921875 7413.00s
POT_8 39.190000 39.695312 18.710000 18.664062 13.120000 16.187500 13804.55s POT_8 38.850000 50.835938 18.400000 22.000000 13.220000 17.156250 13791.90s
FLOAT_3_E1 9.970000 15.734375 10.000000 9.968750 10.000000 9.968750 1384.86s FLOAT_3_E1 9.970000 10.414062 10.000000 10.031250 10.000000 10.031250 1373.64s
FLOAT_4_E1 18.600000 10.773438 11.530000 9.539062 9.750000 8.382812 1780.54s FLOAT_4_E1 19.070000 17.804688 13.440000 18.570312 11.070000 16.796875 1776.63s
FLOAT_4_E2 19.530000 23.335938 12.460000 18.726562 10.830000 17.187500 1778.50s FLOAT_4_E2 19.580000 30.117188 13.520000 11.062500 12.300000 8.750000 1776.39s
FLOAT_5_E1 61.040000 23.507812 16.320000 25.726562 9.940000 11.859375 2579.43s FLOAT_5_E1 59.720000 54.929688 13.430000 8.125000 10.900000 4.164062 2582.35s
FLOAT_5_E2 73.510000 36.351562 26.920000 42.765625 14.370000 24.898438 2585.40s FLOAT_5_E2 72.290000 90.453125 27.040000 40.734375 16.740000 24.265625 2586.83s
FLOAT_5_E3 84.050000 45.218750 28.630000 41.265625 13.650000 26.765625 2581.44s FLOAT_5_E3 83.960000 91.445312 30.770000 26.992188 15.270000 11.718750 2585.13s
FLOAT_6_E1 87.580000 69.328125 36.360000 41.992188 14.300000 7.453125 4150.79s FLOAT_6_E1 87.280000 99.437500 37.980000 50.492188 15.220000 30.375000 4159.25s
FLOAT_6_E2 82.830000 49.992188 27.760000 35.648438 14.260000 22.250000 4152.38s FLOAT_6_E2 83.050000 92.875000 34.450000 24.617188 16.220000 12.578125 4159.07s
FLOAT_6_E3 91.170000 57.562500 37.240000 44.117188 12.300000 8.039062 4164.32s FLOAT_6_E3 90.980000 97.671875 35.900000 52.070312 11.360000 15.593750 4168.01s
FLOAT_6_E4 85.330000 46.023438 30.710000 40.304688 13.220000 26.726562 4160.66s
FLOAT_7_E1 90.300000 83.601562 35.850000 26.359375 15.280000 8.570312 7388.60s
FLOAT_7_E2 85.720000 48.398438 27.820000 32.976562 12.420000 19.898438 7393.53s
FLOAT_7_E3 93.620000 74.273438 43.020000 44.156250 12.260000 13.476562 7409.19s
FLOAT_7_E4 91.100000 59.023438 36.440000 43.937500 11.750000 8.085938 7428.80s
ResNet_18 cifar10 ResNet_18 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.300000 99.984375 47.320000 82.757812 11.300000 60.851562 61.58s Full 94.290000 99.992188 47.290000 87.523438 11.340000 42.296875 43.51s
INT_2 10.000000 9.882812 10.000000 9.882812 10.000000 9.882812 113.99s INT_2 10.000000 9.773438 10.000000 9.773438 10.000000 9.773438 104.55s
INT_3 10.000000 9.625000 10.000000 9.625000 10.000000 9.625000 110.67s INT_3 10.000000 9.796875 10.000000 9.796875 10.000000 9.796875 108.52s
INT_4 49.440000 55.828125 21.800000 34.109375 14.300000 27.742188 115.23s INT_4 49.590000 75.296875 21.800000 26.992188 14.140000 20.625000 109.25s
INT_5 87.620000 98.531250 34.660000 52.773438 20.740000 42.156250 117.49s INT_5 87.350000 99.296875 37.720000 76.992188 21.200000 55.750000 96.75s
INT_6 93.250000 99.945312 47.120000 82.835938 16.640000 66.960938 111.18s INT_6 93.200000 99.992188 47.340000 84.375000 16.610000 49.351562 109.62s
INT_7 94.070000 99.953125 46.560000 81.468750 13.600000 62.968750 110.95s INT_7 94.160000 99.992188 48.190000 87.804688 13.450000 48.304688 103.52s
INT_8 94.260000 99.976562 48.200000 83.757812 12.300000 62.914062 112.09s INT_8 94.300000 99.992188 48.030000 87.484375 12.150000 44.515625 104.98s
INT_9 94.350000 99.976562 47.650000 83.375000 11.700000 62.328125 110.99s INT_9 94.320000 99.992188 47.590000 87.617188 11.620000 43.812500 107.60s
INT_10 94.340000 99.976562 47.670000 82.531250 11.450000 61.117188 108.41s INT_10 94.340000 99.992188 47.500000 87.570312 11.420000 42.718750 110.07s
INT_11 94.290000 99.976562 47.590000 82.851562 11.420000 61.273438 112.16s INT_11 94.310000 99.992188 47.480000 87.617188 11.390000 42.648438 109.50s
INT_12 94.320000 99.984375 47.530000 82.875000 11.280000 61.054688 113.02s INT_12 94.320000 99.992188 47.350000 87.492188 11.360000 42.453125 108.80s
INT_13 94.310000 99.984375 47.490000 82.789062 11.360000 61.078125 113.65s INT_13 94.310000 99.992188 47.360000 87.515625 11.400000 42.460938 105.54s
INT_14 94.320000 99.976562 47.390000 82.820312 11.390000 61.085938 114.14s INT_14 94.310000 99.992188 47.480000 87.500000 11.360000 42.531250 98.59s
INT_15 94.300000 99.976562 47.420000 82.796875 11.330000 61.125000 116.35s INT_15 94.310000 99.992188 47.500000 87.453125 11.310000 42.546875 83.73s
INT_16 94.320000 99.976562 47.340000 82.750000 11.310000 61.164062 112.37s INT_16 94.310000 99.992188 47.420000 87.460938 11.380000 42.429688 103.37s
POT_2 10.000000 9.882812 10.000000 9.882812 10.000000 9.882812 172.08s POT_2 10.000000 9.773438 10.000000 9.773438 10.000000 9.773438 134.49s
POT_3 10.200000 14.468750 10.050000 13.390625 8.030000 11.812500 192.24s POT_3 10.470000 11.820312 10.790000 14.281250 9.700000 13.148438 144.72s
POT_4 63.780000 75.414062 28.790000 18.781250 17.630000 14.562500 233.05s POT_4 63.830000 85.914062 28.690000 35.281250 17.040000 28.085938 173.80s
POT_5 50.530000 51.570312 24.380000 10.195312 13.340000 9.984375 314.09s POT_5 50.440000 76.820312 23.940000 24.914062 13.600000 18.398438 238.65s
POT_6 51.610000 57.195312 24.930000 10.351562 14.880000 10.078125 475.13s POT_6 50.840000 74.820312 25.100000 28.937500 15.050000 22.359375 365.53s
POT_7 49.050000 53.460938 26.370000 11.148438 15.120000 10.148438 805.59s POT_7 50.150000 82.132812 26.350000 29.914062 15.150000 22.601562 624.49s
POT_8 55.540000 59.414062 26.630000 10.859375 16.300000 10.265625 1438.61s POT_8 55.480000 79.007812 25.460000 33.015625 15.920000 27.242188 1136.80s
FLOAT_3_E1 12.740000 15.453125 11.000000 13.179688 11.810000 12.515625 190.74s FLOAT_3_E1 12.940000 14.140625 11.810000 9.093750 11.760000 8.539062 147.73s
FLOAT_4_E1 47.470000 59.093750 22.790000 14.085938 17.650000 12.562500 232.41s FLOAT_4_E1 47.310000 77.710938 22.540000 29.453125 17.580000 24.414062 173.60s
FLOAT_4_E2 52.510000 95.570312 17.470000 27.437500 10.200000 20.601562 233.23s FLOAT_4_E2 52.060000 98.367188 17.680000 36.539062 10.380000 30.210938 174.08s
FLOAT_5_E1 81.840000 91.625000 36.050000 32.656250 18.880000 23.625000 315.02s FLOAT_5_E1 81.970000 99.601562 37.150000 59.421875 19.030000 46.359375 238.89s
FLOAT_5_E2 85.740000 99.890625 35.820000 58.484375 14.070000 37.796875 315.16s FLOAT_5_E2 85.820000 99.953125 37.230000 67.835938 13.910000 41.117188 238.71s
FLOAT_5_E3 89.480000 99.851562 44.030000 75.523438 17.910000 59.203125 315.12s FLOAT_5_E3 89.390000 99.976562 43.470000 81.398438 17.620000 54.335938 238.26s
FLOAT_6_E1 87.390000 98.367188 40.690000 32.328125 16.650000 19.828125 476.72s FLOAT_6_E1 87.570000 99.851562 40.080000 57.023438 16.900000 37.859375 364.11s
FLOAT_6_E2 91.650000 99.914062 42.820000 77.484375 13.280000 56.468750 476.46s FLOAT_6_E2 91.640000 99.976562 42.290000 72.328125 13.640000 40.218750 364.19s
FLOAT_6_E3 93.410000 99.984375 46.900000 83.117188 14.290000 64.664062 476.15s FLOAT_6_E3 93.260000 99.992188 46.720000 87.679688 14.580000 52.750000 365.38s
FLOAT_6_E4 89.530000 99.828125 44.860000 73.500000 18.060000 56.882812 476.13s FLOAT_6_E4 89.470000 99.937500 43.310000 72.617188 17.620000 46.187500 364.41s
FLOAT_7_E1 90.160000 98.796875 42.160000 52.984375 15.160000 36.179688 807.53s FLOAT_7_E1 90.140000 99.968750 41.800000 68.601562 15.340000 42.562500 623.58s
FLOAT_7_E2 92.610000 99.945312 45.390000 80.851562 12.460000 60.054688 807.65s FLOAT_7_E2 92.540000 100.000000 44.830000 78.546875 13.160000 41.812500 624.03s
FLOAT_7_E3 94.080000 99.984375 48.150000 83.132812 13.180000 62.726562 807.36s FLOAT_7_E3 94.060000 99.984375 48.070000 86.906250 13.100000 46.523438 625.24s
FLOAT_7_E4 93.120000 99.929688 47.440000 81.375000 15.060000 61.218750 807.40s FLOAT_7_E4 93.180000 100.000000 47.410000 87.195312 15.070000 52.218750 624.34s
FLOAT_7_E5 89.320000 99.734375 41.960000 62.453125 18.720000 44.476562 807.31s FLOAT_7_E5 89.280000 99.953125 42.670000 79.773438 18.110000 54.515625 623.68s
FLOAT_8_E1 90.340000 99.343750 41.100000 49.804688 14.850000 32.750000 1439.81s FLOAT_8_E1 90.340000 99.960938 41.100000 68.953125 14.610000 42.664062 1137.84s
FLOAT_8_E2 92.250000 99.953125 43.710000 72.687500 13.540000 49.375000 1439.54s FLOAT_8_E2 92.480000 99.984375 43.780000 79.390625 13.240000 45.476562 1137.35s
FLOAT_8_E3 94.240000 99.976562 47.240000 82.289062 11.960000 61.062500 1439.69s FLOAT_8_E3 94.250000 99.992188 47.270000 86.765625 11.960000 43.367188 1139.59s
FLOAT_8_E4 94.060000 99.976562 47.570000 82.531250 12.870000 62.132812 1439.74s FLOAT_8_E4 94.070000 99.984375 47.420000 86.617188 12.910000 46.062500 1138.90s
FLOAT_8_E5 93.310000 99.968750 46.900000 84.390625 14.510000 65.539062 1439.76s FLOAT_8_E5 93.270000 100.000000 47.010000 88.390625 14.690000 53.328125 1137.91s
FLOAT_8_E6 89.410000 99.781250 43.070000 67.773438 18.690000 50.945312 1440.24s FLOAT_8_E6 89.470000 99.960938 42.670000 75.429688 18.970000 51.234375 1137.51s
ResNet_18 cifar10 ResNet_18 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.300000 99.414062 47.310000 47.835938 11.270000 10.867188 59.05s Full 94.290000 99.289062 47.300000 34.210938 11.330000 11.250000 41.24s
INT_2 10.000000 9.843750 10.000000 9.843750 10.000000 9.843750 105.14s INT_2 10.000000 9.843750 10.000000 9.843750 10.000000 9.843750 108.60s
INT_3 10.000000 10.007812 10.000000 10.007812 10.000000 10.007812 105.30s INT_3 10.000000 10.367188 10.000000 10.367188 10.000000 10.367188 106.94s
INT_4 49.440000 28.398438 20.680000 24.406250 14.080000 17.132812 105.48s INT_4 49.350000 43.656250 21.230000 24.343750 14.860000 19.093750 107.43s
INT_5 87.620000 87.671875 34.230000 39.539062 19.800000 19.164062 105.49s INT_5 87.510000 87.703125 37.150000 24.773438 21.750000 16.882812 99.51s
INT_6 93.250000 98.453125 47.820000 52.632812 16.790000 18.226562 105.88s INT_6 93.340000 97.195312 48.210000 37.070312 16.860000 17.500000 107.97s
INT_7 94.070000 98.898438 46.700000 47.726562 13.450000 13.914062 128.22s INT_7 94.190000 98.945312 46.690000 35.640625 13.870000 13.476562 106.72s
INT_8 94.260000 99.398438 48.870000 48.085938 12.440000 12.304688 109.68s INT_8 94.290000 99.281250 48.600000 34.148438 12.640000 11.593750 85.87s
INT_9 94.350000 99.437500 47.720000 49.085938 11.800000 11.414062 126.65s INT_9 94.350000 99.289062 47.580000 34.789062 11.680000 11.710938 86.24s
INT_10 94.340000 99.406250 47.400000 47.968750 11.470000 11.085938 130.41s INT_10 94.330000 99.289062 47.600000 34.101562 11.460000 11.476562 107.20s
INT_11 94.290000 99.414062 47.590000 48.164062 11.430000 11.085938 124.30s INT_11 94.280000 99.296875 47.500000 34.539062 11.360000 11.414062 108.11s
INT_12 94.320000 99.421875 47.470000 48.023438 11.370000 10.812500 105.42s INT_12 94.320000 99.289062 47.450000 34.242188 11.200000 11.367188 106.48s
INT_13 94.310000 99.414062 47.440000 48.015625 11.390000 10.882812 118.16s INT_13 94.310000 99.296875 47.480000 34.203125 11.380000 11.359375 85.25s
INT_14 94.320000 99.414062 47.420000 48.093750 11.190000 10.921875 119.38s INT_14 94.310000 99.289062 47.400000 34.210938 11.300000 11.328125 107.12s
INT_15 94.300000 99.414062 47.470000 48.031250 11.450000 10.921875 126.28s INT_15 94.310000 99.289062 47.440000 34.203125 11.350000 11.320312 107.61s
INT_16 94.320000 99.414062 47.480000 48.093750 11.290000 10.953125 126.69s INT_16 94.320000 99.289062 47.360000 34.234375 11.410000 11.343750 106.59s
POT_2 10.000000 9.843750 10.000000 9.843750 10.000000 9.843750 169.25s POT_2 10.000000 9.843750 10.000000 9.843750 10.000000 9.843750 135.56s
POT_3 10.200000 14.890625 10.350000 10.046875 8.400000 7.742188 190.90s POT_3 10.470000 9.625000 9.970000 10.296875 9.090000 9.421875 144.64s
POT_4 63.780000 61.000000 29.720000 10.218750 17.810000 5.429688 231.81s POT_4 63.790000 60.929688 29.710000 10.273438 17.880000 9.765625 174.06s
POT_5 50.530000 68.671875 26.900000 10.445312 15.230000 4.335938 311.95s POT_5 50.280000 27.320312 24.160000 9.640625 14.020000 9.632812 237.14s
POT_6 51.610000 72.226562 27.290000 10.101562 15.910000 9.226562 472.97s POT_6 51.630000 27.789062 25.250000 9.640625 15.070000 9.632812 362.73s
POT_7 49.050000 71.421875 28.030000 10.531250 15.920000 5.140625 802.77s POT_7 50.400000 29.148438 26.010000 9.648438 14.730000 9.640625 622.94s
POT_8 55.540000 71.281250 28.080000 10.250000 16.380000 8.296875 1439.04s POT_8 56.460000 30.960938 26.000000 9.726562 16.040000 9.640625 1135.80s
FLOAT_3_E1 12.740000 23.578125 11.370000 13.601562 11.430000 13.273438 189.11s FLOAT_3_E1 12.940000 14.335938 11.260000 12.968750 11.970000 12.695312 142.78s
FLOAT_4_E1 47.470000 51.546875 24.570000 13.429688 17.960000 10.171875 228.67s FLOAT_4_E1 47.700000 33.187500 23.870000 10.171875 17.930000 9.835938 172.74s
FLOAT_4_E2 52.510000 82.953125 16.440000 11.648438 9.930000 10.578125 229.72s FLOAT_4_E2 52.180000 77.382812 16.630000 11.343750 10.320000 10.187500 172.64s
FLOAT_5_E1 81.840000 71.031250 37.930000 11.773438 20.110000 5.796875 311.31s FLOAT_5_E1 81.930000 75.179688 37.550000 11.617188 18.790000 9.992188 236.15s
FLOAT_5_E2 85.740000 97.453125 36.790000 35.609375 12.920000 13.664062 313.17s FLOAT_5_E2 85.650000 97.187500 35.290000 13.390625 13.680000 10.148438 238.49s
FLOAT_5_E3 89.480000 95.187500 43.070000 32.476562 17.940000 19.031250 312.07s FLOAT_5_E3 89.390000 96.117188 44.090000 22.218750 17.680000 12.570312 237.10s
FLOAT_6_E1 87.390000 89.695312 41.370000 11.984375 16.970000 1.296875 473.94s FLOAT_6_E1 87.460000 79.148438 42.480000 10.929688 17.770000 9.828125 363.60s
FLOAT_6_E2 91.650000 99.054688 42.760000 38.984375 13.620000 13.421875 473.40s FLOAT_6_E2 91.500000 98.156250 42.080000 25.007812 12.960000 12.046875 362.77s
FLOAT_6_E3 93.410000 99.046875 46.530000 33.992188 14.550000 11.796875 473.30s FLOAT_6_E3 93.420000 98.554688 46.350000 26.539062 14.760000 11.578125 362.86s
FLOAT_6_E4 89.530000 95.625000 44.260000 35.390625 17.820000 20.460938 472.14s FLOAT_6_E4 89.700000 94.046875 42.630000 14.250000 17.640000 10.406250 363.59s
FLOAT_7_E1 90.160000 93.593750 41.590000 15.351562 15.700000 0.828125 801.96s FLOAT_7_E1 90.090000 88.281250 42.040000 12.257812 15.330000 10.031250 624.15s
FLOAT_7_E2 92.610000 99.070312 44.680000 43.726562 12.340000 14.000000 802.51s FLOAT_7_E2 92.520000 98.953125 44.500000 29.218750 12.720000 12.609375 622.39s
FLOAT_7_E3 94.080000 99.437500 48.210000 45.812500 13.040000 12.179688 801.48s FLOAT_7_E3 94.090000 99.078125 48.010000 32.437500 13.020000 12.093750 624.57s
FLOAT_7_E4 93.120000 99.109375 47.720000 40.773438 14.930000 12.601562 801.43s FLOAT_7_E4 93.190000 98.609375 47.840000 30.289062 14.810000 12.460938 624.36s
FLOAT_7_E5 89.320000 95.203125 42.210000 39.250000 17.570000 22.953125 801.24s FLOAT_7_E5 89.370000 96.132812 44.090000 18.437500 19.050000 11.351562 623.93s
FLOAT_8_E1 90.340000 94.007812 41.470000 16.093750 14.760000 0.554688 1437.55s FLOAT_8_E1 90.370000 93.789062 41.420000 11.546875 14.860000 9.882812 1134.85s
FLOAT_8_E2 92.250000 99.171875 43.930000 30.164062 13.510000 12.054688 1439.68s FLOAT_8_E2 92.210000 98.875000 43.960000 20.562500 13.660000 11.000000 1136.18s
FLOAT_8_E3 94.240000 99.398438 47.440000 45.812500 12.370000 12.070312 1438.96s FLOAT_8_E3 94.230000 99.265625 47.060000 32.226562 12.060000 11.171875 1138.17s
FLOAT_8_E4 94.060000 99.382812 47.390000 45.953125 13.020000 12.484375 1438.85s FLOAT_8_E4 94.060000 99.070312 47.470000 31.781250 12.810000 11.843750 1137.50s
FLOAT_8_E5 93.310000 99.031250 46.520000 40.296875 14.590000 12.234375 1438.88s FLOAT_8_E5 93.280000 98.750000 46.850000 30.726562 14.590000 12.531250 1137.01s
FLOAT_8_E6 89.410000 91.976562 42.590000 26.476562 19.140000 15.687500 1439.03s FLOAT_8_E6 89.350000 95.234375 43.540000 21.351562 19.080000 12.265625 1136.39s
ResNet_50 cifar10 ResNet_50 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.570000 99.945312 44.350000 70.015625 8.940000 13.328125 132.07s Full 94.570000 100.000000 44.390000 65.625000 8.970000 19.703125 138.71s
INT_2 10.000000 9.820312 10.000000 9.820312 10.000000 9.820312 325.77s INT_2 10.000000 10.164062 10.000000 10.164062 10.000000 10.164062 305.50s
INT_3 10.040000 14.148438 10.080000 12.039062 10.040000 12.109375 323.77s INT_3 10.040000 10.367188 10.000000 10.718750 10.000000 10.718750 304.82s
INT_4 24.550000 21.554688 11.880000 9.898438 10.870000 9.882812 274.27s INT_4 25.330000 28.195312 11.790000 10.859375 10.370000 10.203125 300.40s
INT_5 79.260000 83.382812 36.870000 39.500000 21.580000 22.937500 311.02s INT_5 78.780000 92.242188 30.700000 48.140625 16.610000 26.820312 308.66s
INT_6 92.880000 99.015625 45.070000 55.203125 15.340000 19.492188 309.83s INT_6 92.640000 99.960938 44.130000 73.976562 17.770000 37.281250 310.66s
INT_7 93.760000 99.921875 44.650000 64.335938 12.250000 14.515625 307.40s INT_7 93.900000 100.000000 44.660000 67.875000 13.000000 26.000000 298.60s
INT_8 94.400000 99.921875 45.510000 71.429688 11.380000 16.343750 307.96s INT_8 94.400000 100.000000 44.810000 68.007812 10.950000 24.609375 304.85s
INT_9 94.510000 99.945312 45.000000 70.609375 9.550000 14.187500 324.85s INT_9 94.560000 100.000000 44.330000 65.468750 9.590000 20.859375 305.57s
INT_10 94.550000 99.945312 44.320000 69.859375 9.180000 13.507812 309.98s INT_10 94.570000 100.000000 44.600000 65.640625 9.300000 20.140625 306.86s
INT_11 94.660000 99.945312 44.560000 70.039062 8.940000 13.304688 308.57s INT_11 94.620000 100.000000 44.620000 65.859375 8.960000 19.859375 306.36s
INT_12 94.580000 99.945312 44.520000 69.953125 8.980000 13.421875 309.40s INT_12 94.580000 100.000000 44.370000 65.796875 8.950000 19.859375 305.67s
INT_13 94.580000 99.945312 44.470000 69.945312 8.950000 13.195312 309.02s INT_13 94.600000 100.000000 44.430000 65.695312 8.970000 19.757812 307.75s
INT_14 94.570000 99.945312 44.470000 69.929688 9.020000 13.171875 308.25s INT_14 94.570000 100.000000 44.520000 65.734375 8.960000 19.757812 310.94s
INT_15 94.570000 99.945312 44.370000 70.031250 8.950000 13.242188 307.84s INT_15 94.570000 100.000000 44.470000 65.718750 8.850000 19.625000 311.52s
INT_16 94.570000 99.945312 44.380000 69.937500 9.030000 13.304688 308.10s INT_16 94.570000 100.000000 44.350000 65.703125 8.790000 19.781250 306.78s
POT_2 10.000000 9.820312 10.000000 9.820312 10.000000 9.820312 485.49s POT_2 10.000000 10.164062 10.000000 10.164062 10.000000 10.164062 491.26s
POT_3 10.390000 12.835938 10.030000 9.585938 9.930000 9.476562 567.34s POT_3 10.210000 6.953125 10.000000 10.718750 10.000000 10.718750 573.10s
POT_4 51.590000 74.953125 19.470000 30.929688 13.380000 19.828125 756.15s POT_4 51.890000 88.445312 22.900000 43.234375 14.750000 30.734375 760.35s
POT_5 50.500000 73.953125 17.320000 36.148438 11.770000 31.187500 1123.11s POT_5 52.190000 86.539062 22.240000 44.101562 14.550000 31.585938 1130.96s
POT_6 55.340000 72.921875 22.490000 39.312500 14.490000 32.406250 1847.88s POT_6 53.810000 81.648438 21.670000 47.992188 14.490000 33.695312 1856.80s
POT_7 50.930000 72.921875 20.260000 36.695312 13.530000 28.648438 3331.46s POT_7 51.750000 88.367188 22.620000 42.367188 14.880000 30.828125 3339.35s
POT_8 44.430000 75.757812 18.900000 32.453125 14.180000 28.312500 6251.90s POT_8 45.850000 87.289062 21.850000 49.648438 14.950000 33.109375 6256.99s
FLOAT_3_E1 9.440000 15.210938 9.810000 3.289062 9.880000 2.976562 567.61s FLOAT_3_E1 9.440000 15.992188 9.780000 10.171875 9.760000 10.164062 572.11s
FLOAT_4_E1 53.580000 32.593750 15.650000 21.671875 13.770000 18.554688 757.48s FLOAT_4_E1 49.160000 74.429688 18.700000 35.523438 14.980000 29.375000 760.87s
FLOAT_4_E2 19.850000 58.656250 9.520000 37.015625 7.560000 35.359375 755.65s FLOAT_4_E2 20.490000 59.890625 10.220000 25.601562 9.170000 21.929688 761.78s
FLOAT_5_E1 83.820000 99.187500 34.970000 45.562500 19.040000 30.539062 1131.80s
FLOAT_5_E2 62.080000 93.765625 19.390000 46.585938 12.170000 33.960938 1131.83s
FLOAT_5_E3 88.850000 99.937500 43.190000 69.312500 19.490000 33.539062 1131.91s
FLOAT_6_E1 87.320000 99.992188 38.180000 59.867188 17.360000 33.640625 1853.80s
FLOAT_6_E2 88.780000 99.851562 32.740000 65.289062 15.990000 40.726562 1855.07s
FLOAT_6_E3 92.970000 99.984375 44.740000 68.953125 14.530000 30.234375 1861.00s
FLOAT_6_E4 88.690000 99.875000 41.930000 69.843750 20.090000 38.140625 1863.06s
FLOAT_7_E1 90.680000 100.000000 41.040000 67.734375 15.620000 34.093750 3329.92s
FLOAT_7_E2 91.870000 99.968750 36.540000 65.257812 15.290000 36.851562 3338.02s
FLOAT_7_E3 94.150000 99.992188 44.800000 66.437500 11.960000 23.648438 3343.19s
FLOAT_7_E4 92.960000 99.984375 45.100000 69.039062 14.680000 30.703125 3348.61s
FLOAT_7_E5 89.080000 99.914062 43.060000 70.718750 19.540000 40.265625 3343.94s
FLOAT_8_E1 90.800000 100.000000 39.790000 63.656250 14.560000 29.757812 6249.40s
FLOAT_8_E2 92.520000 99.984375 37.430000 63.859375 14.220000 35.390625 6253.62s
FLOAT_8_E3 94.450000 100.000000 44.760000 66.234375 10.040000 21.382812 6266.04s
FLOAT_8_E4 94.160000 99.992188 44.750000 66.085938 11.760000 24.015625 6272.60s
ResNet_50 cifar10 ResNet_50 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.570000 95.296875 44.360000 45.945312 8.980000 10.601562 135.24s Full 94.570000 98.062500 44.430000 53.960938 8.960000 9.671875 133.50s
INT_2 10.000000 10.328125 10.000000 10.328125 10.000000 10.328125 313.70s INT_2 10.000000 9.750000 10.000000 9.750000 10.000000 9.750000 308.18s
INT_3 10.040000 13.429688 10.050000 13.992188 10.070000 14.164062 318.85s INT_3 10.040000 8.882812 10.000000 9.937500 10.000000 9.937500 318.38s
INT_4 24.480000 18.546875 10.970000 10.367188 10.650000 10.625000 316.06s INT_4 23.570000 31.992188 12.510000 15.601562 9.970000 14.179688 318.84s
INT_5 79.260000 59.109375 37.500000 27.835938 19.430000 16.328125 296.41s INT_5 79.220000 54.937500 33.960000 42.453125 17.130000 20.875000 318.78s
INT_6 92.840000 90.531250 46.820000 40.570312 15.700000 13.406250 323.31s INT_6 92.330000 92.742188 45.580000 59.757812 14.930000 17.187500 318.26s
INT_7 93.730000 93.828125 43.610000 42.125000 11.800000 10.304688 305.24s INT_7 93.830000 98.062500 44.040000 53.976562 12.580000 13.125000 269.53s
INT_8 94.450000 95.585938 45.520000 48.046875 10.950000 12.203125 303.49s INT_8 94.340000 98.273438 45.650000 56.726562 10.980000 12.164062 317.57s
INT_9 94.550000 94.570312 44.480000 45.390625 9.540000 11.250000 303.94s INT_9 94.560000 97.953125 44.830000 53.750000 9.360000 10.187500 318.50s
INT_10 94.580000 94.906250 44.460000 45.843750 9.100000 10.898438 305.67s INT_10 94.550000 98.070312 44.320000 53.882812 9.190000 9.976562 318.54s
INT_11 94.640000 95.296875 44.510000 45.945312 9.030000 10.500000 308.67s INT_11 94.630000 98.109375 44.550000 54.109375 9.070000 9.765625 318.34s
INT_12 94.580000 95.257812 44.410000 46.054688 8.940000 10.671875 303.62s INT_12 94.610000 98.054688 44.510000 54.070312 9.020000 9.820312 319.13s
INT_13 94.590000 95.273438 44.450000 45.921875 8.950000 10.679688 305.91s INT_13 94.600000 98.054688 44.550000 54.093750 8.850000 9.656250 318.37s
INT_14 94.600000 95.273438 44.470000 45.945312 8.960000 10.695312 272.73s INT_14 94.570000 98.054688 44.450000 54.023438 8.990000 9.679688 319.78s
INT_15 94.570000 95.281250 44.520000 45.835938 8.930000 10.625000 289.87s INT_15 94.570000 98.054688 44.400000 53.960938 9.070000 9.703125 277.23s
INT_16 94.570000 95.296875 44.380000 45.890625 8.950000 10.617188 272.32s INT_16 94.570000 98.046875 44.450000 53.976562 8.860000 9.648438 307.98s
POT_2 10.000000 10.328125 10.000000 10.328125 10.000000 10.328125 485.14s POT_2 10.000000 9.750000 10.000000 9.750000 10.000000 9.750000 475.82s
POT_3 10.260000 12.617188 10.000000 9.578125 10.000000 9.437500 564.90s POT_3 10.100000 10.617188 9.950000 10.476562 9.820000 10.179688 565.03s
POT_4 51.730000 72.195312 19.410000 30.421875 13.800000 24.734375 757.13s POT_4 51.610000 72.015625 18.620000 36.265625 14.310000 26.109375 753.76s
POT_5 53.030000 64.093750 21.140000 26.039062 14.780000 22.023438 1128.74s POT_5 53.890000 76.070312 22.850000 37.453125 15.010000 29.382812 1129.35s
POT_6 55.280000 66.914062 21.140000 33.882812 13.710000 28.804688 1857.15s POT_6 54.980000 75.007812 21.510000 37.687500 14.910000 27.804688 1860.83s
POT_7 51.220000 68.859375 18.990000 30.648438 12.140000 23.312500 3337.61s POT_7 50.580000 76.976562 19.090000 35.023438 12.990000 26.632812 3353.60s
POT_8 44.780000 58.265625 18.930000 25.929688 13.450000 21.671875 6253.15s POT_8 43.650000 76.125000 21.080000 36.328125 14.650000 28.140625 6291.68s
FLOAT_3_E1 9.440000 15.976562 9.010000 8.359375 8.890000 8.507812 567.10s FLOAT_3_E1 9.440000 16.046875 9.610000 10.968750 9.910000 11.210938 563.50s
FLOAT_4_E1 52.520000 40.414062 16.870000 24.734375 12.980000 15.328125 757.10s FLOAT_4_E1 50.510000 45.570312 17.150000 28.359375 14.440000 23.773438 750.90s
FLOAT_4_E2 19.800000 33.039062 10.030000 31.843750 8.310000 28.679688 755.31s FLOAT_4_E2 19.660000 35.406250 10.490000 20.218750 9.220000 16.265625 750.76s
FLOAT_5_E1 84.380000 77.562500 40.060000 40.164062 21.950000 29.828125 1122.66s FLOAT_5_E1 81.530000 88.343750 36.030000 46.484375 19.700000 27.210938 1122.57s
FLOAT_5_E2 63.310000 59.867188 21.590000 31.250000 13.280000 24.078125 1127.25s FLOAT_5_E2 62.380000 77.195312 24.960000 55.578125 14.570000 45.078125 1126.44s
FLOAT_5_E3 88.820000 85.156250 42.390000 45.140625 20.040000 27.195312 1128.58s FLOAT_5_E3 88.970000 93.679688 43.240000 61.632812 20.040000 29.570312 1131.34s
FLOAT_6_E1 87.410000 84.593750 38.790000 45.656250 17.710000 28.890625 1851.13s FLOAT_6_E1 87.400000 96.429688 38.210000 39.195312 17.650000 18.226562 1855.89s
FLOAT_6_E2 88.610000 77.281250 35.700000 45.382812 15.570000 31.609375 1853.98s FLOAT_6_E2 88.640000 86.710938 34.940000 55.000000 15.930000 32.398438 1857.65s
FLOAT_6_E3 92.990000 90.609375 44.470000 49.640625 14.770000 17.515625 1857.08s FLOAT_6_E3 92.960000 96.796875 44.280000 55.820312 15.140000 19.140625 1862.10s
FLOAT_6_E4 88.470000 83.656250 42.930000 49.234375 19.750000 31.250000 1856.95s FLOAT_6_E4 89.110000 93.703125 43.460000 62.976562 20.490000 29.187500 1864.00s
FLOAT_7_E1 90.630000 88.554688 40.630000 48.429688 15.880000 28.632812 3327.18s FLOAT_7_E1 90.690000 97.742188 41.250000 55.898438 15.810000 23.445312 3341.47s
FLOAT_7_E2 91.940000 83.742188 38.530000 50.320312 14.890000 30.359375 3332.99s FLOAT_7_E2 91.840000 93.742188 40.700000 62.796875 15.790000 29.656250 3347.11s
FLOAT_7_E3 94.170000 93.312500 44.200000 46.835938 11.800000 12.992188 3340.01s FLOAT_7_E3 94.100000 97.960938 45.540000 55.992188 11.810000 13.335938 3357.41s
FLOAT_7_E4 92.950000 90.148438 43.750000 49.507812 14.640000 17.976562 3342.85s FLOAT_7_E4 93.040000 97.000000 44.190000 53.914062 15.160000 17.898438 3363.29s
FLOAT_7_E5 88.970000 84.078125 42.870000 47.156250 20.230000 29.546875 3342.01s FLOAT_7_E5 89.040000 93.953125 44.080000 63.617188 20.530000 31.078125 3359.96s
FLOAT_8_E1 90.840000 89.453125 39.530000 45.695312 14.220000 24.164062 6245.58s FLOAT_8_E1 90.940000 97.968750 39.620000 50.781250 14.300000 20.054688 6278.64s
FLOAT_8_E2 92.650000 85.210938 39.950000 52.820312 13.510000 27.437500 6251.00s FLOAT_8_E2 92.550000 94.726562 40.890000 58.554688 14.100000 25.320312 6284.63s
FLOAT_8_E3 94.470000 94.718750 44.390000 46.265625 10.180000 11.757812 6263.01s FLOAT_8_E3 94.500000 97.960938 45.190000 54.914062 10.150000 11.039062 6296.21s
FLOAT_8_E4 94.170000 92.882812 44.530000 48.015625 12.000000 14.109375 6269.03s FLOAT_8_E4 94.150000 97.843750 45.160000 55.132812 11.890000 13.687500 6303.00s
FLOAT_8_E5 92.950000 90.125000 44.670000 50.742188 14.740000 18.765625 6268.95s
FLOAT_8_E6 87.850000 83.859375 41.850000 43.132812 21.560000 28.687500 6267.85s
VGG_16 cifar10 VGG_16 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.130000 99.031250 53.170000 51.195312 18.780000 25.054688 28.36s Full 93.140000 99.984375 53.180000 73.281250 18.730000 18.265625 41.69s
INT_2 10.000000 10.070312 10.000000 10.070312 10.000000 10.070312 70.63s INT_2 10.000000 9.617188 10.000000 9.617188 10.000000 9.617188 83.74s
INT_3 10.020000 9.812500 10.000000 10.070312 10.000000 10.070312 55.48s INT_3 10.020000 9.679688 10.000000 9.617188 10.000000 9.617188 82.89s
INT_4 29.300000 10.828125 11.970000 11.328125 10.190000 10.593750 63.97s INT_4 29.300000 30.171875 12.220000 13.523438 10.280000 11.640625 84.06s
INT_5 88.810000 92.210938 39.680000 52.656250 20.310000 38.015625 72.48s INT_5 88.550000 99.585938 44.180000 68.789062 22.950000 38.742188 83.15s
INT_6 92.500000 98.500000 50.700000 54.453125 21.590000 33.304688 74.44s INT_6 92.310000 99.960938 51.610000 76.320312 21.570000 30.445312 87.73s
INT_7 92.980000 98.812500 52.910000 52.335938 20.730000 29.117188 72.67s INT_7 92.980000 99.984375 53.310000 74.484375 20.360000 23.875000 85.57s
INT_8 93.020000 98.992188 53.240000 51.328125 19.540000 26.250000 62.34s INT_8 93.130000 99.984375 53.300000 73.515625 19.300000 19.789062 83.92s
INT_9 93.050000 99.070312 53.120000 51.601562 19.020000 25.835938 72.20s INT_9 93.080000 99.992188 53.150000 73.617188 19.120000 18.781250 87.32s
INT_10 93.150000 99.000000 53.180000 51.078125 18.930000 25.390625 73.33s INT_10 93.140000 99.992188 53.440000 73.453125 18.820000 18.578125 86.75s
INT_11 93.110000 99.023438 53.070000 51.085938 18.730000 25.179688 68.53s INT_11 93.120000 99.984375 53.130000 73.523438 18.730000 18.351562 88.56s
INT_12 93.140000 99.031250 53.200000 51.062500 18.720000 25.125000 68.94s INT_12 93.160000 99.984375 53.130000 73.257812 18.720000 18.234375 86.08s
INT_13 93.160000 99.023438 53.210000 51.210938 18.730000 25.125000 71.74s INT_13 93.170000 99.984375 53.210000 73.320312 18.670000 18.203125 76.35s
INT_14 93.160000 99.031250 53.190000 51.265625 18.780000 25.101562 72.25s INT_14 93.150000 99.984375 53.070000 73.328125 18.810000 18.218750 70.46s
INT_15 93.130000 99.031250 53.290000 51.148438 18.820000 25.101562 71.79s INT_15 93.140000 99.984375 53.180000 73.226562 18.690000 18.257812 84.03s
INT_16 93.140000 99.031250 53.160000 51.187500 18.700000 25.132812 61.27s INT_16 93.140000 99.984375 53.200000 73.273438 18.740000 18.289062 83.59s
POT_2 10.000000 10.070312 10.000000 10.070312 10.000000 10.070312 89.14s POT_2 10.000000 9.617188 10.000000 9.617188 10.000000 9.617188 108.11s
POT_3 10.450000 13.343750 10.010000 10.148438 10.010000 10.046875 87.41s POT_3 10.450000 11.523438 10.100000 9.328125 9.980000 9.226562 121.95s
POT_4 79.980000 64.750000 43.280000 32.359375 20.620000 22.156250 105.94s POT_4 79.980000 94.062500 43.980000 43.882812 20.540000 22.476562 142.32s
POT_5 79.820000 64.664062 43.910000 31.320312 20.470000 21.453125 143.33s POT_5 79.780000 94.531250 43.650000 43.492188 20.230000 22.468750 191.69s
POT_6 79.670000 65.164062 42.980000 31.812500 20.350000 22.554688 217.25s POT_6 80.060000 94.554688 43.130000 43.640625 20.340000 22.273438 285.98s
POT_7 79.850000 64.421875 43.180000 31.375000 20.320000 21.734375 367.59s POT_7 79.890000 94.414062 43.670000 43.726562 20.560000 22.164062 476.50s
POT_8 79.790000 64.773438 43.390000 31.101562 20.480000 21.281250 665.74s POT_8 79.900000 94.414062 43.730000 43.953125 20.200000 22.710938 847.16s
FLOAT_3_E1 10.130000 10.070312 10.030000 10.085938 10.010000 10.062500 90.55s FLOAT_3_E1 10.130000 9.617188 10.020000 9.617188 10.010000 9.609375 121.17s
FLOAT_4_E1 80.090000 53.960938 35.250000 32.960938 19.880000 24.148438 106.88s FLOAT_4_E1 80.220000 82.320312 38.410000 40.851562 20.620000 22.812500 142.89s
FLOAT_4_E2 72.050000 83.281250 37.510000 34.007812 21.830000 25.718750 107.78s FLOAT_4_E2 72.180000 98.796875 38.460000 44.734375 21.890000 27.890625 141.78s
FLOAT_5_E1 87.670000 76.468750 45.970000 35.593750 20.450000 23.593750 143.18s FLOAT_5_E1 87.580000 97.984375 45.690000 54.992188 20.420000 24.382812 188.53s
FLOAT_5_E2 90.380000 97.765625 49.290000 43.804688 21.410000 28.507812 143.05s FLOAT_5_E2 90.320000 99.953125 49.530000 59.523438 21.390000 27.179688 188.41s
FLOAT_5_E3 89.850000 95.109375 51.530000 42.296875 21.690000 24.343750 143.16s FLOAT_5_E3 89.790000 99.914062 51.740000 61.898438 21.860000 23.171875 189.30s
FLOAT_6_E1 90.200000 85.960938 48.690000 40.906250 20.800000 25.617188 215.65s FLOAT_6_E1 90.310000 99.265625 48.800000 56.414062 20.650000 22.562500 285.49s
FLOAT_6_E2 91.860000 98.812500 50.450000 45.195312 19.170000 26.992188 215.42s FLOAT_6_E2 91.670000 99.968750 50.750000 63.187500 19.030000 23.695312 285.11s
FLOAT_6_E3 92.750000 98.593750 53.610000 50.125000 20.300000 26.750000 215.43s FLOAT_6_E3 92.800000 99.984375 53.710000 73.500000 20.160000 21.625000 285.49s
FLOAT_6_E4 89.750000 95.078125 51.470000 42.039062 21.660000 24.109375 215.40s FLOAT_6_E4 89.540000 99.914062 51.470000 61.570312 21.950000 23.406250 284.82s
FLOAT_7_E1 90.810000 90.343750 49.430000 41.398438 19.780000 25.335938 365.55s FLOAT_7_E1 90.740000 99.625000 49.190000 57.960938 19.660000 22.445312 477.19s
FLOAT_7_E2 91.920000 98.968750 51.530000 45.648438 18.970000 26.421875 366.54s FLOAT_7_E2 92.000000 99.968750 51.830000 64.281250 19.250000 21.984375 476.92s
FLOAT_7_E3 92.890000 99.023438 52.850000 51.203125 19.150000 25.984375 366.76s FLOAT_7_E3 93.010000 99.976562 52.930000 73.539062 19.290000 19.734375 477.05s
FLOAT_7_E4 92.710000 98.578125 53.240000 50.257812 20.240000 27.101562 367.26s FLOAT_7_E4 92.650000 99.992188 53.250000 73.328125 20.280000 21.734375 476.74s
FLOAT_7_E5 89.770000 95.179688 51.810000 42.375000 21.750000 24.351562 366.76s FLOAT_7_E5 89.570000 99.906250 51.590000 61.703125 22.040000 23.484375 476.73s
FLOAT_8_E1 91.190000 91.710938 49.480000 42.101562 19.400000 25.476562 661.73s FLOAT_8_E1 91.060000 99.726562 49.520000 59.312500 19.650000 22.179688 846.79s
FLOAT_8_E2 92.220000 99.132812 52.180000 47.023438 19.320000 26.281250 663.08s FLOAT_8_E2 92.060000 99.984375 52.310000 66.296875 19.340000 22.171875 846.33s
FLOAT_8_E3 93.150000 99.023438 53.110000 50.234375 19.090000 25.382812 662.49s FLOAT_8_E3 93.190000 99.984375 53.060000 72.414062 19.050000 18.695312 846.83s
FLOAT_8_E4 93.000000 99.007812 53.010000 51.062500 19.200000 25.875000 664.14s FLOAT_8_E4 92.970000 99.984375 52.950000 73.101562 19.250000 19.804688 846.89s
FLOAT_8_E5 92.790000 98.632812 53.290000 49.976562 20.310000 26.875000 664.98s FLOAT_8_E5 92.760000 100.000000 53.390000 73.335938 20.410000 21.585938 847.02s
FLOAT_8_E6 89.750000 95.062500 51.650000 42.023438 21.710000 24.554688 665.24s FLOAT_8_E6 89.740000 99.914062 51.510000 62.265625 21.800000 23.937500 847.05s
VGG_16 cifar10 VGG_16 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.140000 99.539062 53.180000 49.640625 18.800000 20.265625 28.55s Full 93.140000 92.148438 53.180000 39.937500 18.710000 18.421875 40.40s
INT_2 10.000000 10.062500 10.000000 10.062500 10.000000 10.062500 70.01s INT_2 10.000000 9.968750 10.000000 9.968750 10.000000 9.968750 85.22s
INT_3 10.020000 9.390625 10.000000 10.062500 10.000000 10.062500 55.97s INT_3 10.020000 10.210938 10.000000 9.968750 10.000000 9.968750 85.17s
INT_4 29.300000 10.687500 11.750000 10.695312 9.820000 10.117188 69.62s INT_4 29.300000 12.359375 11.290000 13.562500 9.750000 12.578125 85.99s
INT_5 88.550000 86.140625 39.580000 53.320312 19.850000 40.585938 65.74s INT_5 88.550000 61.578125 35.920000 36.968750 17.720000 27.390625 85.18s
INT_6 92.310000 98.867188 50.520000 52.898438 21.360000 28.515625 65.59s INT_6 92.310000 89.257812 51.690000 44.187500 21.580000 26.281250 85.68s
INT_7 92.980000 99.437500 52.860000 51.609375 20.450000 24.734375 72.48s INT_7 92.980000 90.554688 52.720000 42.476562 20.460000 22.765625 86.94s
INT_8 93.130000 99.554688 53.380000 49.750000 19.640000 21.234375 75.11s INT_8 93.130000 92.031250 53.460000 39.718750 19.610000 19.421875 84.89s
INT_9 93.080000 99.554688 53.190000 50.328125 19.190000 21.179688 63.08s INT_9 93.080000 92.187500 53.110000 40.414062 19.140000 19.109375 84.99s
INT_10 93.140000 99.554688 53.380000 49.562500 18.820000 20.500000 72.66s INT_10 93.140000 92.132812 53.380000 39.804688 19.030000 18.640625 86.32s
INT_11 93.120000 99.531250 53.100000 49.734375 18.720000 20.437500 57.33s INT_11 93.120000 92.132812 53.230000 39.882812 18.810000 18.429688 85.85s
INT_12 93.160000 99.539062 53.180000 49.578125 18.690000 20.320312 72.70s INT_12 93.160000 92.187500 53.130000 39.953125 18.750000 18.468750 84.90s
INT_13 93.170000 99.539062 53.140000 49.539062 18.720000 20.281250 55.47s INT_13 93.170000 92.179688 53.140000 39.914062 18.880000 18.476562 86.70s
INT_14 93.150000 99.539062 53.220000 49.625000 18.640000 20.320312 72.86s INT_14 93.150000 92.187500 53.110000 39.914062 18.770000 18.453125 85.98s
INT_15 93.140000 99.539062 53.190000 49.710938 18.670000 20.335938 60.35s INT_15 93.140000 92.164062 53.170000 39.937500 18.760000 18.414062 85.75s
INT_16 93.140000 99.539062 53.170000 49.710938 18.740000 20.304688 74.73s INT_16 93.140000 92.140625 53.190000 39.960938 18.660000 18.375000 84.25s
POT_2 10.000000 10.062500 10.000000 10.062500 10.000000 10.062500 88.77s POT_2 10.000000 9.968750 10.000000 9.968750 10.000000 9.968750 107.68s
POT_3 10.450000 12.125000 10.140000 10.210938 9.960000 9.921875 91.41s POT_3 10.450000 10.906250 10.180000 11.460938 9.870000 11.000000 118.04s
POT_4 79.980000 59.140625 43.350000 27.429688 20.610000 21.804688 108.44s POT_4 79.980000 46.898438 43.800000 24.179688 20.140000 18.531250 140.94s
POT_5 79.780000 57.601562 43.470000 27.398438 20.450000 21.515625 143.89s POT_5 79.780000 46.187500 43.510000 24.078125 20.290000 18.460938 189.90s
POT_6 80.060000 57.820312 43.140000 27.375000 20.040000 21.445312 216.30s POT_6 80.060000 46.179688 42.970000 23.937500 20.330000 18.179688 283.56s
POT_7 79.890000 58.921875 43.630000 27.562500 20.730000 21.757812 366.70s POT_7 79.890000 47.187500 43.250000 24.015625 20.450000 18.421875 475.26s
POT_8 79.900000 57.867188 43.730000 27.406250 20.540000 21.945312 664.48s POT_8 79.900000 47.148438 43.580000 23.726562 20.330000 17.984375 845.04s
FLOAT_3_E1 10.130000 10.054688 10.000000 10.062500 10.010000 10.023438 90.10s FLOAT_3_E1 10.130000 9.968750 9.990000 9.960938 9.960000 9.968750 117.15s
FLOAT_4_E1 80.220000 46.203125 35.740000 31.843750 19.140000 23.343750 104.98s FLOAT_4_E1 80.220000 33.164062 34.780000 26.976562 18.170000 20.851562 140.87s
FLOAT_4_E2 72.180000 85.367188 35.890000 33.085938 21.340000 25.484375 109.12s FLOAT_4_E2 72.180000 68.367188 36.980000 31.476562 21.300000 24.679688 140.88s
FLOAT_5_E1 87.580000 84.609375 46.180000 33.101562 20.860000 21.296875 144.63s FLOAT_5_E1 87.580000 52.515625 44.400000 29.375000 20.150000 19.890625 189.05s
FLOAT_5_E2 90.320000 98.515625 48.540000 36.945312 20.950000 21.679688 145.13s FLOAT_5_E2 90.320000 85.429688 48.420000 34.429688 21.120000 22.148438 191.25s
FLOAT_5_E3 89.790000 97.789062 51.460000 36.906250 21.600000 20.562500 144.24s FLOAT_5_E3 89.790000 81.398438 51.430000 32.687500 21.440000 20.046875 189.83s
FLOAT_6_E1 90.310000 92.906250 48.590000 36.343750 20.680000 21.468750 215.38s FLOAT_6_E1 90.310000 63.398438 49.320000 32.281250 20.960000 20.328125 282.66s
FLOAT_6_E2 91.670000 99.187500 50.740000 40.945312 19.230000 21.367188 216.65s FLOAT_6_E2 91.670000 89.578125 50.730000 35.695312 19.960000 21.484375 282.70s
FLOAT_6_E3 92.800000 99.484375 53.400000 48.804688 20.180000 20.765625 215.16s FLOAT_6_E3 92.800000 91.414062 53.060000 38.781250 20.250000 19.179688 283.64s
FLOAT_6_E4 89.540000 98.109375 51.650000 36.203125 21.940000 20.507812 215.94s FLOAT_6_E4 89.540000 81.109375 51.390000 32.625000 21.560000 19.757812 282.59s
FLOAT_7_E1 90.740000 96.718750 49.670000 36.132812 19.640000 21.085938 365.69s FLOAT_7_E1 90.740000 70.695312 49.500000 31.687500 19.960000 19.414062 474.01s
FLOAT_7_E2 92.000000 99.421875 51.320000 42.093750 19.180000 20.632812 365.91s FLOAT_7_E2 92.000000 89.859375 51.110000 36.656250 19.480000 20.906250 474.65s
FLOAT_7_E3 93.010000 99.468750 52.940000 49.523438 19.250000 21.015625 365.89s FLOAT_7_E3 93.010000 91.695312 53.120000 39.898438 19.030000 19.390625 475.17s
FLOAT_7_E4 92.650000 99.406250 53.010000 48.484375 20.330000 21.015625 366.05s FLOAT_7_E4 92.650000 91.515625 53.160000 38.789062 20.240000 19.023438 475.34s
FLOAT_7_E5 89.570000 97.804688 51.280000 36.648438 21.830000 20.546875 366.57s FLOAT_7_E5 89.570000 81.000000 51.330000 32.164062 21.710000 19.953125 475.29s
FLOAT_8_E1 91.060000 96.914062 49.670000 35.992188 19.690000 20.648438 661.56s FLOAT_8_E1 91.060000 73.039062 49.370000 31.757812 19.470000 19.171875 845.01s
FLOAT_8_E2 92.060000 99.468750 52.110000 43.414062 18.690000 21.046875 661.99s FLOAT_8_E2 92.060000 89.773438 51.820000 37.296875 19.160000 20.804688 845.21s
FLOAT_8_E3 93.190000 99.523438 53.030000 48.750000 19.070000 20.531250 663.80s FLOAT_8_E3 93.190000 92.273438 53.130000 39.250000 19.000000 18.718750 846.00s
FLOAT_8_E4 92.970000 99.523438 53.000000 49.328125 19.200000 21.085938 664.10s FLOAT_8_E4 92.970000 91.703125 53.020000 39.617188 19.210000 19.367188 845.24s
FLOAT_8_E5 92.760000 99.445312 53.290000 48.398438 20.350000 20.992188 664.13s FLOAT_8_E5 92.760000 91.421875 53.180000 38.562500 20.340000 19.109375 844.73s
FLOAT_8_E6 89.740000 97.937500 51.530000 36.359375 21.750000 20.710938 664.38s FLOAT_8_E6 89.740000 81.039062 51.300000 32.406250 21.680000 19.945312 845.15s
VGG_19 cifar10 VGG_19 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.020000 99.914062 50.590000 60.492188 16.780000 26.593750 50.74s Full 93.030000 99.992188 50.580000 79.296875 16.860000 21.828125 32.36s
INT_2 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 102.39s INT_2 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 77.36s
INT_3 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 102.14s INT_3 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 85.24s
INT_4 17.330000 22.578125 12.330000 15.132812 9.470000 14.117188 103.49s INT_4 17.340000 20.234375 11.270000 12.906250 10.000000 11.554688 84.62s
INT_5 88.220000 98.562500 36.050000 61.734375 17.140000 41.718750 103.08s INT_5 88.200000 98.507812 32.170000 68.148438 14.600000 36.601562 84.52s
INT_6 92.250000 99.867188 49.620000 69.320312 20.110000 40.828125 93.44s INT_6 92.270000 99.945312 49.500000 82.343750 19.530000 38.179688 64.65s
INT_7 92.760000 99.914062 50.360000 63.726562 18.850000 32.343750 89.96s INT_7 92.800000 99.984375 50.000000 81.156250 18.940000 31.179688 84.94s
INT_8 93.000000 99.921875 50.710000 61.210938 17.760000 28.468750 84.60s INT_8 92.980000 99.976562 50.800000 80.273438 18.110000 25.210938 86.24s
INT_9 93.040000 99.898438 50.460000 60.617188 17.170000 27.273438 101.82s INT_9 93.040000 99.992188 50.600000 79.875000 17.210000 22.812500 84.63s
INT_10 93.060000 99.914062 50.580000 60.523438 16.760000 26.765625 103.82s INT_10 93.050000 99.992188 50.700000 79.328125 16.900000 22.398438 86.87s
INT_11 92.980000 99.921875 50.740000 60.351562 16.920000 26.546875 85.06s INT_11 93.000000 99.992188 50.610000 79.164062 16.980000 22.046875 68.11s
INT_12 93.030000 99.914062 50.580000 60.468750 16.750000 26.625000 84.62s INT_12 93.030000 99.992188 50.660000 79.304688 16.860000 22.054688 63.46s
INT_13 93.010000 99.914062 50.500000 60.523438 16.940000 26.554688 84.16s INT_13 93.020000 99.992188 50.600000 79.265625 16.830000 21.906250 63.65s
INT_14 93.030000 99.914062 50.540000 60.515625 16.870000 26.554688 84.56s INT_14 93.020000 99.992188 50.610000 79.242188 16.830000 21.804688 87.17s
INT_15 93.030000 99.914062 50.540000 60.476562 16.870000 26.562500 104.47s INT_15 93.030000 99.992188 50.510000 79.242188 16.870000 21.890625 86.65s
INT_16 93.030000 99.914062 50.580000 60.437500 16.800000 26.531250 102.85s INT_16 93.020000 99.992188 50.600000 79.304688 16.860000 21.828125 86.33s
POT_2 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 127.08s POT_2 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 100.01s
POT_3 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 138.92s POT_3 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 104.05s
POT_4 71.830000 82.578125 37.830000 24.765625 18.680000 17.468750 165.01s POT_4 71.750000 90.226562 37.850000 30.851562 18.900000 15.140625 121.82s
POT_5 71.960000 81.296875 37.380000 24.375000 18.000000 17.312500 217.42s POT_5 71.750000 90.367188 37.060000 29.031250 18.130000 14.335938 163.50s
POT_6 72.020000 82.164062 37.370000 24.554688 18.310000 17.453125 322.57s POT_6 71.900000 90.265625 37.240000 29.562500 18.430000 14.367188 246.52s
POT_7 71.430000 82.203125 37.540000 24.234375 17.810000 17.039062 537.44s POT_7 71.420000 90.070312 37.400000 29.625000 18.270000 14.375000 415.18s
POT_8 71.450000 81.195312 37.200000 24.437500 18.290000 17.109375 954.10s POT_8 71.330000 90.187500 36.960000 29.406250 18.180000 14.320312 751.17s
FLOAT_3_E1 10.010000 9.679688 9.960000 9.687500 9.970000 9.679688 138.82s FLOAT_3_E1 10.000000 10.117188 10.020000 10.101562 10.040000 10.109375 105.00s
FLOAT_4_E1 77.130000 77.609375 27.980000 43.015625 16.310000 30.054688 163.94s FLOAT_4_E1 77.180000 86.179688 26.660000 44.015625 15.650000 25.382812 124.71s
FLOAT_4_E2 71.290000 94.898438 27.710000 33.773438 18.030000 25.085938 165.68s FLOAT_4_E2 71.290000 93.984375 27.770000 37.125000 18.910000 23.953125 122.54s
FLOAT_5_E1 86.890000 95.406250 42.240000 38.531250 19.310000 23.898438 218.32s FLOAT_5_E1 86.940000 98.000000 42.960000 50.976562 19.940000 22.664062 163.95s
FLOAT_5_E2 88.630000 99.554688 44.110000 47.046875 20.910000 26.898438 219.26s FLOAT_5_E2 88.600000 99.742188 44.310000 53.609375 21.440000 22.585938 163.59s
FLOAT_5_E3 90.500000 99.679688 47.970000 48.367188 19.600000 24.515625 219.31s FLOAT_5_E3 90.470000 99.875000 47.940000 68.703125 19.820000 25.304688 163.11s
FLOAT_6_E1 88.860000 97.664062 44.750000 35.500000 19.350000 20.781250 324.47s FLOAT_6_E1 88.850000 98.960938 43.630000 50.710938 18.710000 20.445312 244.31s
FLOAT_6_E2 91.150000 99.820312 48.270000 52.203125 19.410000 26.687500 324.68s FLOAT_6_E2 91.160000 99.945312 48.690000 66.953125 20.480000 23.187500 243.70s
FLOAT_6_E3 92.420000 99.898438 51.350000 60.164062 18.580000 26.484375 324.80s FLOAT_6_E3 92.440000 99.984375 50.520000 74.906250 18.550000 23.742188 244.99s
FLOAT_6_E4 90.460000 99.710938 47.780000 48.328125 19.350000 24.445312 324.63s FLOAT_6_E4 90.540000 99.843750 48.110000 67.937500 19.800000 25.335938 245.03s
FLOAT_7_E1 89.930000 98.476562 44.670000 35.250000 17.830000 20.281250 537.80s FLOAT_7_E1 89.910000 99.484375 44.570000 51.187500 17.960000 18.617188 411.07s
FLOAT_7_E2 91.910000 99.859375 48.640000 55.484375 19.150000 26.453125 537.25s FLOAT_7_E2 91.930000 99.953125 49.520000 73.554688 19.240000 24.062500 413.48s
FLOAT_7_E3 92.940000 99.914062 50.600000 59.750000 17.260000 27.234375 539.38s FLOAT_7_E3 92.920000 99.984375 50.550000 77.000000 17.700000 23.125000 413.04s
FLOAT_7_E4 92.700000 99.898438 51.310000 60.328125 18.570000 26.500000 539.31s FLOAT_7_E4 92.700000 99.984375 50.650000 74.515625 18.440000 23.460938 412.23s
FLOAT_7_E5 90.600000 99.703125 48.100000 48.070312 19.520000 24.328125 539.27s FLOAT_7_E5 90.580000 99.882812 47.970000 68.007812 19.890000 25.046875 414.15s
FLOAT_8_E1 90.110000 98.507812 45.080000 35.031250 17.500000 19.875000 954.49s FLOAT_8_E1 90.100000 99.484375 44.790000 51.000000 17.400000 18.195312 746.56s
FLOAT_8_E2 92.020000 99.914062 49.220000 55.992188 18.060000 25.960938 952.79s FLOAT_8_E2 92.040000 99.984375 49.740000 72.234375 18.840000 22.367188 746.94s
FLOAT_8_E3 93.100000 99.898438 50.260000 59.765625 17.110000 26.656250 952.70s FLOAT_8_E3 93.090000 99.992188 50.470000 79.890625 17.300000 22.671875 746.83s
FLOAT_8_E4 92.940000 99.906250 50.450000 59.320312 17.310000 27.242188 952.77s FLOAT_8_E4 92.920000 99.976562 50.510000 76.968750 17.860000 22.968750 749.22s
FLOAT_8_E5 92.640000 99.921875 51.410000 60.554688 18.730000 26.437500 954.18s FLOAT_8_E5 92.620000 99.984375 50.500000 74.484375 18.590000 23.414062 749.64s
FLOAT_8_E6 90.790000 99.734375 47.960000 48.148438 19.490000 24.445312 954.13s FLOAT_8_E6 90.770000 99.875000 48.120000 68.195312 19.850000 25.460938 747.53s
VGG_19 cifar10 VGG_19 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.030000 96.468750 50.580000 48.289062 16.840000 14.828125 52.77s Full 93.020000 89.992188 50.590000 69.632812 16.770000 18.296875 33.03s
INT_2 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 96.00s INT_2 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 66.79s
INT_3 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 94.59s INT_3 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 90.69s
INT_4 17.340000 19.406250 12.000000 12.210938 10.190000 11.203125 86.37s INT_4 17.330000 16.601562 11.050000 13.015625 9.770000 12.312500 78.38s
INT_5 88.200000 79.890625 35.510000 37.460938 17.080000 22.085938 95.28s INT_5 88.220000 78.085938 29.820000 39.101562 14.160000 20.367188 85.07s
INT_6 92.270000 93.968750 49.290000 51.601562 20.150000 23.242188 96.17s INT_6 92.250000 86.562500 46.100000 62.359375 19.150000 28.828125 84.46s
INT_7 92.800000 96.117188 50.060000 49.304688 18.910000 18.437500 90.90s INT_7 92.770000 89.625000 49.940000 69.726562 19.230000 25.617188 84.58s
INT_8 92.980000 96.226562 50.590000 48.484375 17.920000 16.695312 90.05s INT_8 93.000000 89.875000 50.560000 70.015625 18.160000 21.640625 84.65s
INT_9 93.040000 96.367188 50.320000 48.421875 17.180000 15.632812 92.23s INT_9 93.040000 89.953125 50.550000 69.515625 17.250000 19.218750 89.04s
INT_10 93.050000 96.453125 50.610000 48.523438 16.900000 15.312500 90.34s INT_10 93.060000 89.960938 50.390000 69.609375 16.890000 18.906250 86.77s
INT_11 93.000000 96.460938 50.580000 48.328125 16.930000 15.031250 90.91s INT_11 92.980000 90.015625 50.670000 69.492188 16.940000 18.593750 84.55s
INT_12 93.030000 96.460938 50.600000 48.390625 16.840000 14.921875 90.62s INT_12 93.030000 90.000000 50.660000 69.718750 16.910000 18.421875 73.71s
INT_13 93.020000 96.460938 50.560000 48.304688 16.840000 14.898438 92.62s INT_13 93.010000 89.968750 50.510000 69.625000 16.830000 18.328125 87.00s
INT_14 93.020000 96.460938 50.510000 48.289062 16.850000 14.906250 91.85s INT_14 93.030000 89.992188 50.600000 69.632812 16.780000 18.335938 86.86s
INT_15 93.030000 96.460938 50.550000 48.226562 16.820000 14.890625 90.73s INT_15 93.030000 89.984375 50.570000 69.500000 16.850000 18.328125 85.38s
INT_16 93.020000 96.468750 50.640000 48.250000 16.730000 14.929688 93.51s INT_16 93.030000 89.992188 50.600000 69.578125 16.870000 18.281250 64.76s
POT_2 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 131.40s POT_2 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 106.87s
POT_3 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 142.94s POT_3 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 107.78s
POT_4 71.750000 51.281250 37.890000 26.898438 18.670000 18.296875 169.33s POT_4 71.830000 76.234375 37.910000 34.812500 19.100000 16.945312 119.69s
POT_5 71.750000 50.445312 36.830000 25.984375 18.010000 17.914062 221.88s POT_5 71.960000 75.953125 37.280000 33.117188 18.420000 15.718750 161.44s
POT_6 71.900000 51.773438 37.120000 26.546875 18.570000 18.000000 325.98s POT_6 72.020000 75.531250 37.290000 33.148438 18.450000 15.914062 243.88s
POT_7 71.420000 52.296875 37.100000 26.640625 18.220000 17.828125 540.99s POT_7 71.430000 75.585938 37.340000 33.640625 18.410000 15.781250 413.52s
POT_8 71.330000 51.046875 37.440000 26.000000 18.410000 17.500000 955.80s POT_8 71.450000 76.304688 37.020000 32.484375 18.440000 15.492188 748.47s
FLOAT_3_E1 10.000000 9.953125 10.070000 9.960938 10.010000 9.953125 139.87s FLOAT_3_E1 10.010000 9.945312 10.010000 9.945312 10.010000 9.953125 101.25s
FLOAT_4_E1 77.180000 53.250000 26.920000 36.937500 15.590000 26.500000 167.38s FLOAT_4_E1 77.130000 78.914062 24.240000 36.367188 14.280000 21.773438 119.58s
FLOAT_4_E2 71.290000 80.570312 28.350000 31.726562 17.350000 23.281250 166.30s FLOAT_4_E2 71.290000 75.562500 31.030000 39.164062 20.470000 25.968750 123.27s
FLOAT_5_E1 86.940000 76.109375 42.550000 39.476562 19.490000 24.515625 219.69s FLOAT_5_E1 86.890000 90.695312 42.000000 52.640625 19.860000 26.000000 164.82s
FLOAT_5_E2 88.600000 92.351562 44.490000 41.062500 21.190000 18.078125 219.69s FLOAT_5_E2 88.630000 85.484375 45.390000 60.171875 22.560000 26.304688 164.71s
FLOAT_5_E3 90.470000 95.218750 47.770000 41.828125 19.290000 18.851562 220.72s FLOAT_5_E3 90.500000 90.820312 47.480000 65.671875 19.430000 23.250000 165.53s
FLOAT_6_E1 88.850000 85.789062 44.830000 38.187500 19.830000 22.335938 325.89s FLOAT_6_E1 88.860000 91.429688 43.140000 58.734375 18.170000 25.898438 246.30s
FLOAT_6_E2 91.160000 93.945312 48.750000 45.328125 19.660000 19.773438 325.96s FLOAT_6_E2 91.150000 86.921875 49.010000 62.867188 20.520000 22.562500 246.60s
FLOAT_6_E3 92.440000 96.523438 51.350000 47.250000 18.790000 12.625000 325.88s FLOAT_6_E3 92.420000 90.125000 51.170000 71.203125 19.000000 20.796875 245.14s
FLOAT_6_E4 90.540000 95.109375 48.140000 41.835938 19.490000 18.242188 325.96s FLOAT_6_E4 90.460000 90.703125 47.730000 65.203125 19.370000 22.882812 246.12s
FLOAT_7_E1 89.910000 87.546875 44.600000 38.703125 17.840000 22.023438 540.81s FLOAT_7_E1 89.930000 91.773438 45.040000 59.898438 17.930000 23.531250 414.54s
FLOAT_7_E2 91.930000 95.109375 49.150000 46.820312 19.320000 19.820312 540.80s FLOAT_7_E2 91.910000 87.757812 49.750000 64.414062 19.070000 20.414062 412.78s
FLOAT_7_E3 92.920000 96.328125 50.620000 48.382812 17.310000 15.632812 540.87s FLOAT_7_E3 92.940000 90.226562 51.080000 70.078125 17.770000 19.742188 414.78s
FLOAT_7_E4 92.700000 96.546875 51.260000 47.156250 18.720000 12.664062 540.89s FLOAT_7_E4 92.700000 90.070312 51.210000 71.281250 19.020000 20.796875 415.24s
FLOAT_7_E5 90.580000 95.226562 47.660000 41.632812 19.500000 18.468750 540.80s FLOAT_7_E5 90.600000 90.664062 47.600000 65.484375 19.250000 22.929688 415.50s
FLOAT_8_E1 90.100000 87.765625 45.000000 38.296875 17.510000 21.710938 955.80s FLOAT_8_E1 90.110000 91.625000 45.200000 59.890625 18.270000 22.289062 747.48s
FLOAT_8_E2 92.040000 95.437500 49.610000 47.187500 18.310000 19.351562 955.09s FLOAT_8_E2 92.020000 88.554688 50.030000 63.796875 18.720000 19.195312 747.61s
FLOAT_8_E3 93.090000 96.468750 50.520000 47.914062 16.990000 15.812500 954.98s FLOAT_8_E3 93.100000 90.078125 50.510000 69.960938 17.060000 18.859375 748.34s
FLOAT_8_E4 92.920000 96.375000 50.560000 48.312500 17.400000 15.710938 955.04s FLOAT_8_E4 92.940000 90.195312 50.850000 70.203125 17.800000 19.781250 749.56s
FLOAT_8_E5 92.620000 96.703125 51.200000 47.195312 18.730000 12.593750 955.57s FLOAT_8_E5 92.640000 90.093750 51.290000 70.914062 18.780000 20.859375 750.04s
FLOAT_8_E6 90.770000 94.867188 47.870000 41.742188 19.570000 18.664062 954.81s FLOAT_8_E6 90.790000 90.757812 47.380000 65.257812 19.300000 23.062500 749.96s
AlexNet cifar100 AlexNet cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 63.440000 99.781250 21.870000 58.664062 7.790000 20.382812 8.91s Full 63.440000 99.679688 21.870000 57.429688 7.740000 19.351562 12.58s
INT_2 1.000000 0.960938 1.000000 0.960938 1.000000 0.960938 27.25s INT_2 1.000000 0.859375 1.000000 0.859375 1.000000 0.859375 28.85s
INT_3 0.990000 1.195312 1.000000 0.960938 1.000000 0.960938 27.09s INT_3 0.990000 1.062500 1.000000 0.859375 1.000000 0.859375 27.61s
INT_4 15.960000 27.812500 3.650000 9.210938 2.870000 7.562500 26.44s INT_4 15.960000 26.148438 3.330000 8.265625 2.910000 6.679688 24.44s
INT_5 46.760000 89.523438 14.230000 25.921875 11.530000 19.718750 26.94s INT_5 46.760000 89.617188 14.060000 23.664062 11.200000 18.414062 25.88s
INT_6 58.120000 98.859375 20.030000 46.726562 14.010000 33.867188 27.15s INT_6 58.120000 98.632812 19.480000 45.015625 14.120000 32.265625 27.52s
INT_7 61.680000 99.507812 21.820000 55.445312 11.780000 31.750000 27.73s INT_7 61.680000 99.507812 21.260000 53.867188 11.640000 30.320312 28.27s
INT_8 62.860000 99.750000 22.370000 57.468750 9.870000 25.929688 24.49s INT_8 62.860000 99.726562 21.950000 56.140625 9.720000 24.546875 20.89s
INT_9 63.150000 99.773438 22.030000 58.265625 8.570000 22.343750 25.93s INT_9 63.160000 99.640625 21.930000 57.085938 8.630000 21.539062 22.21s
INT_10 63.360000 99.789062 22.140000 58.531250 8.090000 21.296875 20.20s INT_10 63.360000 99.664062 21.990000 57.429688 8.070000 20.054688 28.54s
INT_11 63.360000 99.781250 22.100000 58.718750 7.920000 20.679688 19.94s INT_11 63.360000 99.671875 22.030000 57.351562 7.900000 19.648438 27.91s
INT_12 63.400000 99.789062 21.940000 58.664062 7.740000 20.500000 19.83s INT_12 63.380000 99.671875 21.890000 57.539062 7.810000 19.312500 26.19s
INT_13 63.440000 99.773438 21.980000 58.757812 7.780000 20.296875 19.74s INT_13 63.440000 99.671875 21.950000 57.445312 7.710000 19.343750 29.04s
INT_14 63.430000 99.773438 21.870000 58.734375 7.740000 20.335938 22.01s INT_14 63.430000 99.679688 21.910000 57.476562 7.770000 19.312500 29.82s
INT_15 63.450000 99.781250 21.950000 58.679688 7.750000 20.343750 28.26s INT_15 63.450000 99.679688 21.910000 57.492188 7.720000 19.304688 29.11s
INT_16 63.440000 99.781250 21.890000 58.679688 7.720000 20.453125 27.28s INT_16 63.440000 99.679688 21.970000 57.445312 7.710000 19.273438 24.32s
POT_2 1.000000 0.960938 1.000000 0.960938 1.000000 0.960938 31.73s POT_2 1.000000 0.859375 1.000000 0.859375 1.000000 0.859375 34.42s
POT_3 1.330000 1.992188 1.030000 0.968750 1.020000 0.960938 34.02s POT_3 1.330000 2.117188 1.060000 0.875000 1.030000 0.867188 34.57s
POT_4 24.460000 37.812500 6.950000 12.546875 4.390000 7.921875 36.31s POT_4 24.460000 38.187500 6.940000 11.945312 4.380000 7.734375 33.99s
POT_5 25.240000 38.757812 6.860000 12.976562 4.070000 7.562500 44.06s POT_5 25.240000 38.890625 7.220000 12.875000 4.200000 7.742188 45.53s
POT_6 24.910000 39.328125 7.130000 12.851562 4.310000 7.921875 59.85s POT_6 24.910000 39.171875 7.240000 12.843750 4.030000 7.835938 59.74s
POT_7 24.810000 37.171875 7.270000 12.867188 4.160000 7.585938 92.18s POT_7 24.810000 37.742188 7.310000 13.367188 4.060000 7.242188 94.08s
POT_8 25.050000 38.906250 7.120000 12.718750 4.130000 7.531250 161.44s POT_8 25.050000 38.195312 7.110000 12.773438 4.080000 7.742188 161.17s
FLOAT_3_E1 1.960000 2.929688 1.450000 1.757812 1.190000 1.328125 30.23s FLOAT_3_E1 1.960000 3.140625 1.510000 1.679688 1.250000 1.445312 32.48s
FLOAT_4_E1 15.090000 19.953125 7.860000 6.531250 5.730000 4.953125 35.10s FLOAT_4_E1 15.090000 20.625000 7.600000 6.429688 5.800000 5.335938 35.75s
FLOAT_4_E2 18.310000 41.609375 4.630000 4.023438 3.960000 3.765625 33.30s FLOAT_4_E2 18.310000 41.820312 4.880000 3.914062 3.720000 3.250000 34.44s
FLOAT_5_E1 38.590000 72.234375 14.170000 21.953125 9.610000 12.617188 44.45s FLOAT_5_E1 38.590000 72.437500 14.180000 21.335938 9.680000 12.312500 41.59s
FLOAT_5_E2 44.250000 91.476562 13.070000 22.640625 8.780000 14.507812 43.65s FLOAT_5_E2 44.250000 91.007812 13.030000 21.359375 8.810000 13.914062 41.66s
FLOAT_5_E3 50.410000 91.835938 17.620000 41.953125 8.930000 19.648438 45.00s FLOAT_5_E3 50.410000 91.867188 17.620000 40.796875 8.870000 19.554688 41.67s
FLOAT_6_E1 48.020000 81.992188 17.060000 25.007812 9.070000 8.937500 59.66s FLOAT_6_E1 48.020000 82.242188 16.960000 24.210938 9.230000 8.945312 57.80s
FLOAT_6_E2 55.160000 97.992188 16.790000 35.453125 8.730000 18.320312 58.73s FLOAT_6_E2 55.150000 97.554688 17.000000 35.171875 8.640000 17.812500 57.71s
FLOAT_6_E3 59.950000 98.812500 21.100000 53.242188 9.260000 22.585938 57.76s FLOAT_6_E3 59.950000 98.632812 21.140000 51.867188 9.100000 21.304688 57.91s
FLOAT_6_E4 49.880000 91.546875 17.620000 41.804688 8.830000 19.796875 58.66s FLOAT_6_E4 49.880000 92.023438 17.500000 40.835938 8.800000 19.265625 57.87s
FLOAT_7_E1 51.440000 88.687500 18.360000 31.421875 8.520000 10.320312 93.81s FLOAT_7_E1 51.440000 89.195312 18.100000 30.679688 8.530000 10.000000 93.10s
FLOAT_7_E2 58.390000 98.789062 17.930000 41.304688 8.260000 18.765625 93.89s FLOAT_7_E2 58.410000 98.640625 18.070000 40.414062 8.350000 17.898438 93.81s
FLOAT_7_E3 62.220000 99.601562 21.890000 56.132812 8.620000 20.601562 93.65s FLOAT_7_E3 62.230000 99.445312 21.640000 54.812500 8.590000 19.812500 92.03s
FLOAT_7_E4 60.150000 98.742188 21.200000 53.140625 8.920000 22.117188 92.42s FLOAT_7_E4 60.140000 98.578125 20.840000 51.695312 8.790000 21.164062 94.07s
FLOAT_7_E5 50.190000 91.726562 17.770000 41.757812 8.690000 19.820312 93.67s FLOAT_7_E5 50.190000 92.085938 17.640000 41.007812 8.620000 19.125000 93.75s
FLOAT_8_E1 53.620000 90.671875 18.810000 35.398438 7.840000 10.742188 160.80s FLOAT_8_E1 53.620000 91.015625 18.730000 34.132812 7.990000 10.437500 159.42s
FLOAT_8_E2 58.680000 99.031250 18.510000 42.804688 8.330000 18.171875 160.99s FLOAT_8_E2 58.660000 98.812500 18.520000 41.835938 8.130000 17.164062 160.69s
FLOAT_8_E3 62.860000 99.750000 21.930000 57.921875 8.130000 20.843750 159.48s FLOAT_8_E3 62.860000 99.578125 21.970000 56.968750 8.070000 19.562500 160.85s
FLOAT_8_E4 62.490000 99.507812 21.980000 56.250000 8.680000 20.507812 159.30s FLOAT_8_E4 62.490000 99.382812 22.050000 54.953125 8.460000 19.765625 161.68s
FLOAT_8_E5 60.100000 98.718750 20.930000 53.304688 9.170000 22.414062 159.52s FLOAT_8_E5 60.040000 98.656250 20.900000 52.335938 9.080000 21.562500 160.62s
FLOAT_8_E6 50.440000 91.523438 17.520000 41.765625 8.950000 19.757812 161.18s FLOAT_8_E6 50.440000 91.531250 17.570000 40.453125 8.590000 19.289062 159.71s
AlexNet_BN cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 66.310000 99.984375 21.330000 40.921875 6.780000 5.437500 14.75s
INT_2 1.000000 1.085938 1.000000 1.085938 1.000000 1.085938 34.36s
INT_3 1.220000 1.539062 1.000000 1.164062 1.000000 1.164062 34.29s
INT_4 9.130000 11.039062 2.570000 3.039062 2.210000 1.937500 34.05s
INT_5 40.130000 88.500000 9.310000 14.859375 6.710000 9.703125 34.63s
INT_6 61.870000 99.875000 18.370000 32.273438 10.210000 12.328125 34.30s
INT_7 65.940000 99.968750 21.980000 39.421875 9.490000 9.664062 34.13s
INT_8 66.210000 99.984375 21.260000 40.429688 7.760000 7.078125 34.20s
INT_9 66.440000 99.984375 21.350000 40.125000 7.170000 5.984375 33.69s
INT_10 66.310000 99.992188 21.240000 40.632812 6.890000 5.585938 34.32s
INT_11 66.410000 99.984375 21.420000 41.054688 6.890000 5.546875 33.94s
INT_12 66.390000 99.984375 21.350000 41.023438 6.800000 5.523438 34.06s
INT_13 66.350000 99.984375 21.430000 40.921875 6.800000 5.507812 34.01s
INT_14 66.300000 99.984375 21.350000 40.968750 6.770000 5.476562 34.17s
INT_15 66.310000 99.984375 21.310000 40.937500 6.740000 5.492188 34.34s
INT_16 66.320000 99.984375 21.300000 40.976562 6.790000 5.515625 34.04s
POT_2 1.000000 1.085938 1.000000 1.085938 1.000000 1.085938 49.13s
POT_3 1.680000 1.554688 1.630000 1.921875 1.690000 1.960938 47.92s
POT_4 26.770000 53.875000 8.560000 7.148438 4.640000 3.195312 49.07s
POT_5 26.920000 53.398438 8.680000 6.656250 4.440000 2.812500 55.68s
POT_6 26.480000 53.500000 8.890000 6.679688 4.750000 2.992188 70.93s
POT_7 26.570000 53.171875 8.680000 6.835938 4.730000 3.140625 103.86s
POT_8 26.470000 52.820312 8.660000 6.820312 4.780000 3.046875 169.75s
FLOAT_3_E1 2.050000 1.843750 1.510000 0.882812 1.200000 0.750000 48.35s
FLOAT_4_E1 15.020000 25.289062 3.860000 2.828125 2.590000 1.382812 49.82s
FLOAT_4_E2 23.470000 34.914062 4.720000 3.875000 3.440000 2.515625 49.33s
FLOAT_5_E1 36.740000 74.625000 7.990000 7.687500 4.210000 1.742188 55.84s
FLOAT_5_E2 51.740000 93.968750 12.500000 13.484375 6.840000 5.031250 55.69s
FLOAT_5_E3 53.530000 94.929688 17.130000 24.210938 7.780000 6.187500 55.99s
FLOAT_6_E1 45.170000 86.882812 9.900000 10.179688 4.470000 1.679688 71.40s
FLOAT_6_E2 59.520000 99.117188 16.690000 22.085938 7.510000 6.171875 71.22s
FLOAT_6_E3 63.110000 99.890625 19.040000 36.781250 6.920000 6.875000 70.96s
FLOAT_6_E4 53.760000 95.234375 17.570000 24.359375 8.080000 6.148438 71.02s
FLOAT_7_E1 53.170000 94.429688 12.320000 15.546875 4.660000 1.929688 104.08s
FLOAT_7_E2 63.210000 99.835938 19.080000 29.445312 7.850000 7.742188 104.24s
FLOAT_7_E3 65.220000 99.929688 20.140000 38.171875 6.810000 5.562500 104.14s
FLOAT_7_E4 63.530000 99.875000 19.050000 36.492188 6.920000 6.945312 103.90s
FLOAT_7_E5 53.790000 94.773438 17.580000 24.757812 7.930000 6.117188 104.08s
FLOAT_8_E1 53.650000 95.359375 12.550000 15.468750 4.520000 1.671875 169.52s
FLOAT_8_E2 63.580000 99.937500 19.730000 31.187500 7.930000 7.406250 169.34s
FLOAT_8_E3 66.500000 99.984375 21.490000 40.960938 6.980000 5.695312 169.49s
FLOAT_8_E4 65.360000 99.929688 20.050000 38.093750 6.820000 5.375000 169.84s
FLOAT_8_E5 63.290000 99.828125 19.060000 36.742188 7.060000 6.960938 169.50s
FLOAT_8_E6 53.480000 95.312500 17.010000 24.546875 8.090000 6.132812 169.50s
AlexNet_BN cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 66.310000 68.218750 21.280000 62.460938 6.780000 6.945312 12.79s
INT_2 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 33.06s
INT_3 1.210000 1.890625 1.000000 0.992188 1.000000 0.992188 33.15s
INT_4 9.170000 18.039062 3.080000 5.398438 2.540000 3.312500 33.00s
INT_5 40.280000 42.109375 9.300000 26.132812 6.510000 13.937500 32.36s
INT_6 61.890000 57.578125 18.310000 51.828125 10.040000 23.046875 32.92s
INT_7 65.890000 65.234375 21.390000 59.937500 9.420000 17.882812 32.86s
INT_8 66.330000 66.992188 21.380000 61.437500 8.010000 11.585938 32.95s
INT_9 66.440000 68.359375 21.410000 62.171875 7.320000 8.578125 32.54s
INT_10 66.350000 68.195312 21.090000 62.625000 6.960000 7.515625 32.76s
INT_11 66.340000 68.054688 21.390000 62.562500 6.890000 7.210938 32.91s
INT_12 66.370000 68.226562 21.400000 62.570312 6.810000 7.007812 32.69s
INT_13 66.350000 68.203125 21.410000 62.679688 6.770000 6.968750 32.90s
INT_14 66.290000 68.203125 21.350000 62.554688 6.730000 6.953125 33.32s
INT_15 66.290000 68.218750 21.360000 62.562500 6.740000 7.015625 33.20s
INT_16 66.310000 68.226562 21.310000 62.500000 6.720000 6.960938 32.93s
POT_2 1.000000 1.000000 1.000000 1.000000 1.000000 1.000000 46.96s
POT_3 1.660000 3.156250 1.190000 0.875000 1.120000 0.851562 46.55s
POT_4 26.780000 32.781250 8.820000 14.351562 4.850000 3.343750 47.91s
POT_5 26.910000 32.812500 9.090000 14.656250 4.540000 2.757812 54.77s
POT_6 26.480000 32.570312 8.660000 14.390625 4.850000 2.875000 70.14s
POT_7 26.580000 33.046875 8.660000 14.484375 4.800000 2.992188 102.89s
POT_8 26.450000 32.851562 8.840000 14.601562 4.740000 2.882812 168.57s
FLOAT_3_E1 2.040000 3.007812 1.450000 1.125000 1.280000 1.007812 46.65s
FLOAT_4_E1 14.990000 22.546875 3.340000 4.656250 2.270000 2.234375 47.69s
FLOAT_4_E2 23.460000 18.656250 3.550000 5.898438 2.840000 4.437500 47.49s
FLOAT_5_E1 36.740000 43.265625 7.630000 10.960938 4.160000 1.343750 54.69s
FLOAT_5_E2 51.700000 42.789062 12.070000 28.851562 6.470000 17.140625 54.74s
FLOAT_5_E3 53.520000 48.843750 16.790000 39.562500 7.680000 17.242188 55.09s
FLOAT_6_E1 45.070000 49.898438 9.960000 13.320312 4.480000 1.351562 70.63s
FLOAT_6_E2 59.660000 53.921875 15.470000 39.710938 7.040000 16.351562 70.12s
FLOAT_6_E3 63.140000 63.726562 18.990000 55.023438 7.000000 17.335938 70.33s
FLOAT_6_E4 53.820000 49.523438 17.540000 39.242188 8.130000 16.882812 70.11s
FLOAT_7_E1 53.170000 53.695312 12.530000 19.460938 4.850000 0.953125 102.97s
FLOAT_7_E2 63.210000 58.914062 18.900000 45.585938 7.330000 14.359375 102.87s
FLOAT_7_E3 65.210000 67.882812 20.180000 58.429688 6.750000 9.757812 102.87s
FLOAT_7_E4 63.510000 63.945312 19.080000 54.710938 6.820000 16.882812 102.87s
FLOAT_7_E5 53.800000 49.445312 17.700000 39.546875 8.010000 17.054688 102.50s
FLOAT_8_E1 53.640000 55.109375 12.740000 20.039062 4.750000 0.875000 168.19s
FLOAT_8_E2 63.650000 58.710938 19.550000 47.835938 7.720000 12.937500 168.42s
FLOAT_8_E3 66.520000 68.359375 21.350000 61.632812 7.010000 7.906250 168.26s
FLOAT_8_E4 65.360000 67.773438 20.230000 58.289062 6.710000 9.507812 168.59s
FLOAT_8_E5 63.430000 63.703125 19.080000 54.703125 6.990000 17.148438 168.33s
FLOAT_8_E6 53.320000 49.062500 16.950000 39.953125 7.550000 17.046875 168.26s
AlexNet cifar100 AlexNet cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 63.440000 65.804688 21.880000 53.984375 7.660000 6.578125 8.41s Full 63.440000 65.085938 21.880000 53.726562 7.780000 6.750000 11.74s
INT_2 1.000000 1.093750 1.000000 1.093750 1.000000 1.093750 23.27s INT_2 1.000000 1.117188 1.000000 1.117188 1.000000 1.117188 27.84s
INT_3 0.990000 1.640625 1.000000 1.093750 1.000000 1.093750 21.28s INT_3 0.990000 1.617188 1.000000 1.117188 1.000000 1.117188 26.97s
INT_4 15.960000 13.703125 2.340000 4.437500 1.950000 4.085938 21.70s INT_4 15.960000 13.429688 2.150000 5.250000 1.950000 3.898438 26.33s
INT_5 46.760000 41.851562 12.940000 19.562500 10.280000 15.484375 29.08s INT_5 46.760000 41.375000 12.910000 19.679688 10.130000 15.937500 28.36s
INT_6 58.120000 52.031250 19.850000 34.242188 14.180000 21.562500 23.98s INT_6 58.120000 52.554688 20.180000 34.640625 14.300000 21.882812 27.00s
INT_7 61.680000 62.367188 21.370000 47.414062 11.940000 19.070312 26.71s INT_7 61.680000 62.054688 20.950000 48.343750 12.120000 19.984375 28.09s
INT_8 62.860000 63.937500 22.190000 52.859375 9.820000 12.234375 25.46s INT_8 62.860000 63.796875 21.960000 52.765625 9.900000 12.734375 26.50s
INT_9 63.160000 65.367188 22.220000 53.437500 8.680000 8.500000 19.93s INT_9 63.160000 64.968750 22.310000 53.367188 8.730000 8.929688 27.37s
INT_10 63.360000 65.679688 21.890000 53.906250 8.190000 7.335938 28.45s INT_10 63.360000 65.257812 22.080000 53.898438 8.100000 7.562500 27.15s
INT_11 63.360000 65.617188 22.180000 54.023438 7.850000 6.945312 26.87s INT_11 63.360000 65.171875 22.110000 53.945312 7.850000 7.023438 19.82s
INT_12 63.380000 65.703125 21.910000 53.812500 7.840000 6.570312 22.55s INT_12 63.380000 65.031250 21.970000 53.968750 7.810000 6.812500 19.99s
INT_13 63.440000 65.812500 21.880000 54.109375 7.790000 6.625000 23.92s INT_13 63.440000 65.078125 21.940000 53.796875 7.700000 6.804688 20.00s
INT_14 63.430000 65.773438 21.990000 54.007812 7.690000 6.554688 22.24s INT_14 63.430000 65.109375 21.990000 53.773438 7.790000 6.703125 20.63s
INT_15 63.450000 65.804688 21.930000 54.000000 7.730000 6.687500 23.07s INT_15 63.450000 65.085938 21.990000 53.875000 7.690000 6.742188 26.09s
INT_16 63.440000 65.796875 21.920000 53.968750 7.790000 6.601562 19.49s INT_16 63.440000 65.078125 21.930000 53.867188 7.780000 6.757812 21.59s
POT_2 1.000000 1.093750 1.000000 1.093750 1.000000 1.093750 33.10s POT_2 1.000000 1.117188 1.000000 1.117188 1.000000 1.117188 34.29s
POT_3 1.330000 2.359375 1.000000 1.093750 1.000000 1.093750 33.87s POT_3 1.330000 1.867188 1.000000 1.117188 1.010000 1.117188 33.87s
POT_4 24.460000 21.984375 7.210000 10.726562 4.430000 6.500000 35.21s POT_4 24.460000 22.007812 7.210000 10.718750 4.300000 6.515625 36.45s
POT_5 25.240000 23.015625 7.100000 10.679688 3.860000 5.765625 43.64s POT_5 25.240000 22.671875 7.050000 10.796875 3.840000 6.242188 44.86s
POT_6 24.910000 22.734375 7.130000 10.867188 4.040000 5.960938 59.41s POT_6 24.910000 22.703125 7.180000 10.828125 4.120000 6.039062 60.63s
POT_7 24.810000 23.109375 7.120000 10.476562 4.020000 5.523438 93.92s POT_7 24.810000 22.890625 7.230000 10.343750 3.880000 5.843750 93.70s
POT_8 25.050000 22.726562 7.380000 10.609375 3.810000 5.875000 160.87s POT_8 25.050000 22.703125 7.250000 10.804688 4.200000 5.750000 161.10s
FLOAT_3_E1 1.960000 1.664062 1.050000 1.312500 1.070000 1.164062 37.02s FLOAT_3_E1 1.960000 1.804688 1.080000 1.242188 0.940000 1.046875 31.65s
FLOAT_4_E1 15.090000 11.257812 6.890000 4.078125 5.000000 1.796875 37.46s FLOAT_4_E1 15.090000 10.781250 6.570000 4.320312 4.950000 2.320312 36.09s
FLOAT_4_E2 18.310000 11.132812 5.500000 3.250000 4.670000 2.773438 36.25s FLOAT_4_E2 18.310000 11.234375 5.040000 3.187500 4.150000 2.835938 35.86s
FLOAT_5_E1 38.590000 30.023438 14.710000 9.929688 10.150000 3.289062 43.81s FLOAT_5_E1 38.590000 29.585938 14.290000 9.679688 9.840000 3.085938 43.92s
FLOAT_5_E2 44.250000 33.789062 13.560000 16.523438 9.300000 8.218750 45.09s FLOAT_5_E2 44.250000 34.046875 13.530000 16.093750 9.150000 8.578125 42.90s
FLOAT_5_E3 50.410000 40.882812 16.380000 32.531250 8.120000 13.789062 45.03s FLOAT_5_E3 50.410000 40.867188 16.250000 33.500000 7.950000 13.453125 44.50s
FLOAT_6_E1 48.020000 38.218750 16.760000 17.492188 9.100000 3.851562 59.94s FLOAT_6_E1 48.020000 38.398438 16.350000 17.601562 9.090000 3.671875 59.87s
FLOAT_6_E2 55.150000 46.351562 17.260000 32.960938 8.870000 12.203125 59.64s FLOAT_6_E2 55.150000 45.750000 17.110000 32.695312 9.030000 12.421875 59.08s
FLOAT_6_E3 59.950000 60.585938 21.310000 46.125000 9.260000 5.523438 59.46s FLOAT_6_E3 59.950000 60.242188 21.390000 46.164062 9.430000 5.398438 59.46s
FLOAT_6_E4 49.880000 41.445312 16.450000 33.078125 7.880000 13.578125 59.79s FLOAT_6_E4 49.880000 42.109375 16.640000 33.492188 7.990000 13.421875 59.42s
FLOAT_7_E1 51.440000 40.226562 17.770000 26.625000 8.190000 4.960938 94.36s FLOAT_7_E1 51.440000 40.609375 18.100000 27.156250 8.310000 5.179688 93.36s
FLOAT_7_E2 58.410000 51.968750 18.080000 39.398438 8.650000 10.492188 93.51s FLOAT_7_E2 58.410000 51.781250 18.000000 38.726562 8.650000 11.023438 93.62s
FLOAT_7_E3 62.230000 63.578125 21.860000 52.304688 8.610000 8.937500 93.97s FLOAT_7_E3 62.230000 63.609375 22.010000 52.578125 8.410000 9.304688 93.41s
FLOAT_7_E4 60.140000 60.273438 21.240000 46.125000 9.240000 5.507812 93.16s FLOAT_7_E4 60.140000 60.039062 21.320000 47.117188 9.180000 5.515625 93.36s
FLOAT_7_E5 50.190000 41.195312 16.190000 32.390625 7.940000 13.273438 93.84s FLOAT_7_E5 50.190000 40.851562 16.790000 33.117188 7.900000 13.320312 93.75s
FLOAT_8_E1 53.620000 43.640625 18.290000 27.578125 7.720000 4.625000 161.06s FLOAT_8_E1 53.620000 43.718750 18.390000 27.906250 7.700000 4.421875 160.31s
FLOAT_8_E2 58.660000 54.062500 18.560000 42.382812 8.340000 9.492188 160.72s FLOAT_8_E2 58.660000 53.625000 18.630000 41.554688 8.240000 9.382812 160.61s
FLOAT_8_E3 62.860000 65.648438 21.950000 54.078125 8.060000 7.453125 160.37s FLOAT_8_E3 62.860000 65.023438 22.080000 54.062500 8.090000 7.796875 160.82s
FLOAT_8_E4 62.490000 63.945312 21.700000 52.523438 8.410000 8.953125 160.88s FLOAT_8_E4 62.490000 63.890625 21.970000 52.562500 8.360000 9.320312 160.34s
FLOAT_8_E5 60.040000 59.562500 21.440000 46.468750 9.160000 5.718750 161.28s FLOAT_8_E5 60.040000 59.601562 21.230000 46.687500 9.320000 5.539062 159.76s
FLOAT_8_E6 50.440000 41.125000 16.410000 32.968750 8.110000 13.093750 161.59s FLOAT_8_E6 50.440000 41.312500 16.370000 33.617188 7.970000 13.515625 160.66s
Inception_BN cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 77.980000 100.000000 18.820000 50.742188 3.160000 5.734375 158.41s
INT_2 1.000000 1.039062 1.000000 1.039062 1.000000 1.039062 325.41s
INT_3 0.960000 1.093750 0.910000 1.046875 0.950000 1.085938 326.94s
INT_4 5.810000 14.421875 2.290000 3.671875 1.600000 2.703125 328.17s
INT_5 58.690000 97.671875 15.120000 32.992188 6.730000 13.148438 276.80s
INT_6 74.310000 100.000000 19.440000 51.476562 5.100000 13.531250 327.44s
INT_7 77.390000 100.000000 18.800000 49.328125 3.930000 7.296875 318.29s
INT_8 77.710000 100.000000 19.050000 50.648438 3.510000 6.945312 326.46s
INT_9 77.970000 100.000000 19.010000 50.820312 3.290000 6.226562 326.54s
INT_10 77.990000 100.000000 18.820000 50.812500 3.280000 5.742188 326.74s
INT_11 78.000000 100.000000 19.040000 50.890625 3.160000 5.765625 326.96s
INT_12 77.970000 100.000000 18.950000 50.937500 3.150000 5.671875 314.52s
INT_13 77.980000 100.000000 18.870000 50.851562 3.100000 5.671875 326.49s
INT_14 77.960000 100.000000 18.860000 50.820312 3.050000 5.679688 312.38s
INT_15 77.970000 100.000000 18.890000 50.875000 3.100000 5.617188 326.84s
INT_16 77.970000 100.000000 18.830000 50.820312 3.140000 5.742188 327.69s
POT_2 1.000000 1.039062 1.000000 1.039062 1.000000 1.039062 436.23s
POT_3 1.150000 1.210938 1.110000 1.164062 1.060000 1.015625 500.70s
POT_4 3.900000 1.609375 2.190000 1.085938 1.750000 1.000000 638.38s
POT_5 5.540000 4.796875 2.900000 1.007812 1.200000 0.945312 903.21s
POT_6 5.910000 4.218750 2.310000 1.585938 1.060000 1.234375 1416.19s
POT_7 2.610000 1.507812 1.680000 0.984375 1.010000 1.000000 2475.07s
Inception_BN cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 77.980000 99.218750 18.830000 40.039062 3.130000 5.562500 154.64s
INT_2 1.000000 1.007812 1.000000 1.007812 1.000000 1.007812 275.26s
INT_3 0.970000 0.921875 0.860000 0.929688 0.940000 0.804688 323.32s
INT_4 5.930000 5.570312 2.190000 2.085938 1.700000 1.742188 323.53s
INT_5 59.110000 65.851562 12.880000 21.023438 5.560000 9.343750 324.01s
INT_6 74.500000 94.546875 19.920000 42.367188 5.400000 11.492188 288.96s
INT_7 76.990000 98.937500 19.450000 39.445312 4.220000 7.023438 324.45s
INT_8 77.730000 99.179688 19.070000 40.859375 3.550000 6.578125 324.55s
INT_9 77.930000 99.164062 18.980000 40.039062 3.310000 5.687500 324.50s
INT_10 77.880000 99.257812 18.930000 40.273438 3.130000 5.625000 314.12s
INT_11 77.950000 99.218750 18.930000 40.101562 3.140000 5.531250 312.54s
INT_12 77.960000 99.218750 19.130000 40.218750 3.120000 5.546875 313.09s
INT_13 77.990000 99.226562 19.000000 40.250000 3.160000 5.492188 316.49s
INT_14 77.980000 99.226562 18.930000 40.164062 3.120000 5.570312 320.60s
INT_15 77.980000 99.226562 18.920000 40.132812 3.140000 5.531250 325.56s
INT_16 77.980000 99.226562 18.890000 40.210938 3.110000 5.476562 315.73s
POT_2 1.000000 1.007812 1.000000 1.007812 1.000000 1.007812 435.28s
POT_3 1.150000 1.140625 0.960000 1.078125 1.020000 1.140625 498.34s
POT_4 3.800000 1.343750 1.730000 1.093750 1.030000 1.195312 636.46s
POT_5 5.030000 2.296875 2.540000 1.085938 1.610000 0.789062 901.41s
POT_6 5.960000 2.476562 2.710000 1.695312 1.250000 1.085938 1415.18s
POT_7 2.390000 1.039062 1.230000 1.007812 0.880000 1.007812 2471.09s
POT_8 6.220000 1.773438 2.510000 1.398438 1.340000 1.085938 4551.56s
FLOAT_3_E1 0.960000 1.109375 0.910000 0.992188 0.950000 1.109375 498.34s
FLOAT_4_E1 3.570000 2.929688 2.050000 1.710938 1.180000 2.609375 633.97s
FLOAT_4_E2 28.950000 22.554688 6.260000 7.453125 3.270000 3.937500 634.64s
FLOAT_5_E1 10.690000 1.164062 3.430000 1.195312 1.850000 1.062500 898.78s
FLOAT_5_E2 61.230000 72.820312 13.830000 21.328125 5.350000 8.507812 898.30s
FLOAT_5_E3 60.900000 81.953125 15.790000 9.062500 5.820000 3.554688 899.82s
FLOAT_6_E1 15.700000 3.125000 5.530000 1.671875 2.630000 1.062500 1415.02s
FLOAT_6_E2 70.090000 87.679688 16.300000 33.648438 4.770000 9.835938 1414.31s
FLOAT_6_E3 72.970000 97.859375 19.570000 38.812500 5.110000 8.601562 1412.69s
FLOAT_6_E4 55.400000 79.906250 13.400000 11.304688 4.200000 2.929688 1414.91s
FLOAT_7_E1 29.910000 9.406250 8.630000 2.367188 3.470000 1.140625 2469.52s
FLOAT_7_E2 73.490000 95.312500 18.040000 36.976562 4.630000 8.437500 2470.05s
FLOAT_7_E3 76.560000 98.921875 19.060000 39.671875 4.010000 6.445312 2472.60s
FLOAT_7_E4 73.870000 97.906250 19.750000 35.000000 5.260000 7.093750 2556.43s
FLOAT_7_E5 45.870000 45.304688 14.610000 6.484375 6.140000 2.796875 2590.43s
FLOAT_8_E1 33.140000 7.390625 8.690000 2.351562 3.500000 1.125000 4667.34s
FLOAT_8_E2 74.600000 96.218750 18.330000 37.414062 4.360000 8.554688 4714.86s
FLOAT_8_E3 77.590000 99.234375 18.710000 40.289062 3.630000 5.664062 4641.09s
FLOAT_8_E4 76.610000 99.007812 19.390000 38.476562 3.910000 6.210938 4643.28s
FLOAT_8_E5 73.930000 98.414062 19.920000 39.406250 5.070000 9.812500 4641.37s
FLOAT_8_E6 55.500000 88.062500 15.590000 19.796875 4.930000 6.828125 4637.62s
MobileNetV2 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 66.770000 100.000000 17.360000 35.632812 2.970000 1.406250 58.76s
INT_2 1.000000 1.070312 1.000000 1.070312 1.000000 1.070312 218.32s
INT_3 1.000000 0.914062 1.000000 0.914062 1.000000 0.914062 218.50s
INT_4 0.900000 0.960938 1.140000 0.867188 0.940000 1.156250 220.03s
INT_5 7.530000 11.484375 2.470000 2.265625 1.990000 1.781250 206.20s
INT_6 35.120000 94.890625 12.090000 21.632812 6.500000 11.335938 218.84s
INT_7 56.420000 99.914062 14.640000 33.242188 5.120000 7.539062 139.01s
INT_8 62.870000 100.000000 17.690000 38.664062 4.080000 4.835938 220.28s
INT_9 66.250000 100.000000 17.560000 36.781250 3.490000 2.218750 169.83s
INT_10 66.810000 100.000000 17.510000 36.125000 3.100000 1.617188 140.70s
INT_11 66.880000 100.000000 17.260000 35.921875 3.100000 1.468750 217.09s
INT_12 66.740000 100.000000 17.450000 35.648438 2.970000 1.437500 218.18s
INT_13 66.780000 100.000000 17.250000 35.703125 2.960000 1.320312 216.93s
INT_14 66.760000 100.000000 17.340000 35.828125 3.000000 1.343750 219.67s
INT_15 66.820000 100.000000 17.250000 35.742188 2.960000 1.328125 217.02s
INT_16 66.760000 100.000000 17.310000 35.687500 2.970000 1.296875 216.79s
POT_2 1.000000 1.070312 1.000000 1.070312 1.000000 1.070312 251.43s
POT_3 0.950000 0.421875 1.010000 0.914062 1.000000 0.906250 244.31s
POT_4 2.200000 1.718750 0.950000 1.085938 0.980000 1.062500 256.77s
POT_5 1.880000 2.046875 0.990000 0.875000 1.000000 0.828125 317.75s
POT_6 1.410000 1.531250 1.050000 1.085938 1.010000 1.054688 435.44s
POT_7 2.310000 2.460938 1.040000 1.242188 1.010000 1.046875 684.54s
POT_8 1.740000 2.242188 1.240000 1.187500 1.080000 1.039062 1177.58s
FLOAT_3_E1 1.030000 0.875000 1.060000 1.054688 0.970000 1.039062 228.75s
FLOAT_4_E1 1.010000 1.117188 0.990000 1.023438 0.930000 1.039062 236.63s
FLOAT_4_E2 1.700000 1.562500 1.090000 1.171875 1.030000 1.007812 239.24s
FLOAT_5_E1 2.120000 2.031250 1.030000 1.054688 0.960000 1.039062 296.44s
FLOAT_5_E2 12.560000 21.859375 3.000000 2.343750 2.360000 1.390625 296.12s
FLOAT_5_E3 12.890000 21.960938 3.590000 3.398438 2.220000 2.414062 295.71s
FLOAT_6_E1 3.750000 3.476562 1.310000 2.085938 1.020000 1.289062 414.50s
FLOAT_6_E2 22.200000 67.679688 5.850000 3.828125 3.920000 1.656250 414.86s
FLOAT_6_E3 39.070000 94.476562 10.390000 16.968750 3.860000 4.085938 414.97s
FLOAT_6_E4 13.140000 20.867188 3.770000 3.304688 2.720000 2.148438 414.72s
FLOAT_7_E1 4.530000 4.671875 1.140000 2.039062 0.970000 1.070312 662.74s
FLOAT_7_E2 37.490000 90.476562 8.270000 9.859375 4.700000 4.000000 689.42s
FLOAT_7_E3 58.070000 99.945312 18.380000 33.781250 5.000000 4.656250 688.78s
FLOAT_7_E4 37.710000 95.085938 11.280000 17.203125 4.030000 4.296875 664.14s
FLOAT_7_E5 12.800000 23.671875 3.460000 3.585938 2.250000 2.328125 663.73s
FLOAT_8_E1 5.410000 6.359375 1.010000 1.210938 0.990000 1.070312 1180.47s
FLOAT_8_E2 43.080000 96.976562 10.120000 10.882812 5.000000 3.820312 1183.19s
FLOAT_8_E3 64.170000 99.992188 17.550000 38.617188 3.660000 2.843750 1186.50s
FLOAT_8_E4 57.540000 99.851562 18.030000 35.585938 4.820000 4.968750 1185.50s
FLOAT_8_E5 38.120000 94.929688 10.780000 17.835938 3.870000 3.914062 1186.81s
FLOAT_8_E6 12.540000 18.289062 3.000000 3.203125 2.470000 2.695312 1186.15s
MobileNetV2 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 66.770000 64.289062 17.360000 28.289062 2.960000 2.593750 56.25s
INT_2 1.000000 1.062500 1.000000 1.062500 1.000000 1.062500 217.93s
INT_3 1.000000 1.000000 1.000000 1.046875 1.000000 1.046875 220.51s
INT_4 0.900000 1.242188 1.160000 0.914062 1.100000 0.859375 217.43s
INT_5 7.530000 2.851562 3.060000 2.242188 2.610000 2.359375 219.79s
INT_6 35.120000 37.304688 10.920000 19.132812 5.580000 11.421875 222.35s
INT_7 56.420000 57.671875 16.570000 28.828125 5.370000 11.250000 218.43s
INT_8 62.870000 62.210938 16.680000 29.531250 3.960000 7.281250 218.33s
INT_9 66.250000 63.554688 17.770000 26.609375 3.360000 2.726562 219.42s
INT_10 66.810000 63.429688 17.350000 27.093750 3.150000 3.093750 219.85s
INT_11 66.880000 64.273438 17.460000 28.757812 3.110000 3.492188 137.04s
INT_12 66.740000 64.367188 17.220000 28.257812 2.970000 2.632812 221.04s
INT_13 66.780000 64.382812 17.370000 28.179688 2.980000 2.734375 219.47s
INT_14 66.760000 64.242188 17.310000 28.343750 2.990000 2.609375 221.43s
INT_15 66.820000 64.312500 17.370000 28.242188 3.010000 2.601562 219.59s
INT_16 66.760000 64.312500 17.300000 28.250000 2.980000 2.531250 217.29s
POT_2 1.000000 1.062500 1.000000 1.062500 1.000000 1.062500 250.59s
POT_3 0.950000 0.695312 1.000000 1.054688 1.000000 1.046875 235.17s
POT_4 2.200000 2.843750 1.230000 1.109375 1.210000 0.992188 240.91s
POT_5 1.880000 2.421875 1.190000 1.718750 1.100000 1.882812 316.71s
POT_6 1.410000 2.476562 1.190000 1.125000 1.130000 0.976562 435.12s
POT_7 2.310000 2.570312 1.310000 1.398438 1.190000 0.968750 689.27s
POT_8 1.740000 2.296875 1.330000 1.062500 0.960000 0.906250 1182.93s
FLOAT_3_E1 1.030000 0.968750 1.000000 1.132812 0.890000 1.070312 245.03s
FLOAT_4_E1 1.010000 1.054688 1.130000 1.125000 1.140000 0.992188 258.91s
FLOAT_4_E2 1.700000 1.296875 1.410000 0.992188 1.230000 1.023438 260.43s
FLOAT_5_E1 2.120000 1.390625 1.610000 1.742188 1.390000 1.429688 298.65s
FLOAT_5_E2 12.560000 5.320312 3.360000 4.195312 2.620000 3.328125 307.02s
FLOAT_5_E3 12.890000 13.148438 7.390000 8.687500 4.820000 7.609375 316.26s
FLOAT_6_E1 3.750000 1.492188 2.550000 1.335938 1.980000 0.984375 435.04s
FLOAT_6_E2 22.200000 11.593750 6.760000 7.992188 4.550000 6.507812 435.66s
FLOAT_6_E3 39.070000 26.984375 11.500000 13.828125 4.100000 9.507812 435.24s
FLOAT_6_E4 13.140000 13.203125 5.350000 5.781250 3.310000 4.710938 433.17s
FLOAT_7_E1 4.530000 1.820312 2.570000 1.289062 2.000000 0.843750 663.61s
FLOAT_7_E2 37.490000 14.390625 8.700000 16.531250 5.080000 11.796875 663.73s
FLOAT_7_E3 58.070000 57.101562 18.160000 33.187500 4.870000 15.804688 664.12s
FLOAT_7_E4 37.710000 25.695312 11.520000 15.789062 4.300000 11.976562 683.74s
FLOAT_7_E5 12.800000 16.789062 5.770000 4.687500 3.660000 3.726562 684.77s
FLOAT_8_E1 5.410000 2.679688 3.030000 1.648438 1.810000 0.765625 1181.57s
FLOAT_8_E2 43.080000 31.320312 9.980000 15.335938 5.040000 9.960938 1182.79s
FLOAT_8_E3 64.170000 63.476562 16.500000 27.671875 3.590000 9.437500 1178.53s
FLOAT_8_E4 57.540000 55.882812 17.420000 34.515625 5.010000 20.187500 1179.99s
FLOAT_8_E5 38.120000 24.945312 9.780000 10.398438 3.610000 6.625000 1159.81s
FLOAT_8_E6 12.540000 12.687500 4.350000 2.656250 2.870000 2.414062 1178.40s
ResNet_152 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 77.430000 78.593750 22.490000 33.421875 5.210000 7.031250 327.59s
INT_2 1.000000 0.960938 1.000000 0.960938 1.000000 0.960938 826.23s
INT_3 1.290000 1.140625 1.090000 0.984375 1.000000 0.984375 828.20s
INT_4 2.650000 3.234375 1.320000 1.039062 1.280000 1.007812 847.75s
INT_5 29.980000 5.828125 3.280000 3.093750 2.060000 1.710938 846.54s
INT_6 62.420000 17.296875 7.070000 12.273438 3.470000 9.789062 846.03s
INT_7 74.730000 54.218750 16.090000 17.710938 5.780000 3.039062 837.28s
INT_8 77.070000 75.304688 20.220000 28.515625 5.620000 6.171875 836.56s
INT_9 77.340000 77.843750 21.680000 30.812500 5.460000 6.242188 835.78s
INT_10 77.310000 78.750000 22.430000 33.453125 5.440000 7.437500 833.38s
INT_11 77.470000 78.640625 22.280000 33.289062 5.270000 7.343750 828.87s
INT_12 77.440000 78.625000 22.340000 33.218750 5.290000 6.898438 833.67s
INT_13 77.440000 78.671875 22.360000 33.273438 5.350000 6.960938 772.10s
INT_14 77.430000 78.695312 22.320000 33.210938 5.210000 6.867188 831.54s
INT_15 77.430000 78.671875 22.370000 33.242188 5.330000 6.976562 832.05s
INT_16 77.450000 78.703125 22.410000 33.265625 5.200000 6.953125 829.97s
POT_2 1.000000 0.960938 1.000000 0.960938 1.000000 0.960938 1170.30s
POT_3 1.480000 0.968750 1.110000 0.695312 1.100000 0.687500 1352.45s
POT_4 6.250000 8.578125 1.770000 1.195312 1.450000 1.445312 1759.18s
POT_5 7.100000 7.914062 1.210000 2.015625 1.220000 1.570312 2560.07s
POT_6 7.890000 8.289062 2.030000 1.875000 1.630000 1.523438 4141.17s
POT_7 7.770000 8.398438 1.380000 1.773438 1.210000 1.664062 7387.50s
POT_8 6.340000 7.453125 1.460000 0.898438 1.260000 0.718750 13780.70s
FLOAT_3_E1 1.000000 0.921875 1.000000 0.921875 1.000000 0.921875 1355.99s
FLOAT_4_E1 2.300000 3.140625 2.120000 1.609375 1.570000 0.882812 1756.50s
FLOAT_4_E2 6.320000 6.195312 1.160000 1.015625 1.100000 0.726562 1759.71s
FLOAT_5_E1 29.670000 14.726562 5.820000 7.226562 3.370000 5.921875 2564.15s
FLOAT_5_E2 38.430000 12.304688 6.640000 5.445312 4.350000 3.210938 2567.52s
FLOAT_5_E3 53.700000 30.679688 12.470000 14.234375 6.680000 7.039062 2565.11s
FLOAT_6_E1 40.080000 43.195312 13.140000 12.992188 6.580000 3.351562 4122.90s
FLOAT_6_E2 54.500000 20.273438 8.840000 10.125000 5.110000 6.390625 4127.76s
FLOAT_6_E3 68.520000 50.304688 17.360000 17.414062 6.360000 7.507812 4234.30s
FLOAT_6_E4 51.890000 30.210938 12.090000 12.742188 5.910000 5.859375 4344.37s
FLOAT_7_E1 52.400000 52.515625 17.510000 20.609375 7.610000 6.023438 7537.79s
FLOAT_7_E2 63.160000 29.281250 11.970000 10.789062 6.450000 6.226562 7542.93s
FLOAT_7_E3 74.540000 67.046875 20.180000 24.460938 5.900000 7.187500 7568.45s
FLOAT_7_E4 68.900000 51.765625 17.760000 17.554688 6.340000 7.679688 7515.06s
ResNet_18 cifar100 ResNet_18 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 75.720000 100.000000 18.720000 72.023438 4.580000 9.796875 41.82s Full 75.710000 100.000000 18.760000 72.828125 4.560000 10.000000 39.98s
INT_2 1.050000 0.937500 1.000000 1.046875 1.000000 1.046875 101.36s INT_2 1.050000 0.945312 1.000000 0.937500 1.000000 0.937500 108.23s
INT_3 1.110000 1.164062 1.140000 0.890625 1.040000 0.976562 103.44s INT_3 1.110000 0.867188 1.020000 0.921875 1.020000 0.875000 107.87s
INT_4 6.050000 18.429688 2.100000 4.140625 1.290000 2.445312 84.53s INT_4 5.900000 16.656250 2.040000 4.437500 1.290000 2.882812 109.11s
INT_5 50.970000 95.859375 11.460000 32.476562 5.310000 14.367188 96.83s INT_5 50.980000 95.843750 11.660000 35.929688 5.970000 19.601562 109.27s
INT_6 70.860000 100.000000 18.540000 68.101562 7.300000 23.320312 101.82s INT_6 70.930000 99.984375 18.530000 66.718750 7.270000 21.929688 110.52s
INT_7 74.530000 99.992188 18.460000 66.476562 5.890000 15.171875 108.33s INT_7 74.660000 100.000000 18.640000 64.945312 5.930000 14.546875 94.10s
INT_8 75.420000 100.000000 18.340000 70.250000 5.350000 14.757812 103.04s INT_8 75.390000 100.000000 18.310000 70.742188 5.460000 15.234375 83.48s
INT_9 75.290000 100.000000 18.530000 71.007812 5.090000 14.656250 90.25s INT_9 75.260000 100.000000 18.490000 71.507812 5.170000 14.789062 108.70s
INT_10 75.500000 100.000000 18.470000 71.429688 5.070000 14.210938 106.96s INT_10 75.520000 100.000000 18.340000 71.601562 5.020000 14.210938 83.04s
INT_11 75.420000 100.000000 18.460000 71.023438 5.020000 14.171875 103.37s INT_11 75.430000 100.000000 18.440000 71.828125 5.020000 14.226562 108.12s
INT_12 75.500000 100.000000 18.570000 71.500000 4.950000 13.500000 106.11s INT_12 75.510000 100.000000 18.590000 72.148438 4.990000 13.664062 100.80s
INT_13 75.400000 100.000000 18.510000 71.289062 5.020000 14.000000 105.36s INT_13 75.400000 100.000000 18.420000 71.726562 5.020000 14.226562 109.84s
INT_14 75.380000 100.000000 18.420000 71.210938 5.020000 14.218750 106.59s INT_14 75.380000 100.000000 18.450000 71.773438 5.040000 14.382812 83.11s
INT_15 75.430000 100.000000 18.530000 71.335938 5.010000 13.796875 103.67s INT_15 75.430000 100.000000 18.500000 71.929688 5.000000 13.882812 109.54s
INT_16 75.380000 100.000000 18.550000 71.273438 4.990000 14.125000 101.68s INT_16 75.380000 100.000000 18.450000 71.656250 4.970000 14.437500 110.43s
POT_2 1.000000 1.132812 1.000000 1.046875 1.000000 1.046875 132.63s POT_2 1.000000 0.945312 1.000000 0.937500 1.000000 0.937500 138.60s
POT_3 1.000000 0.882812 1.000000 0.992188 1.000000 0.992188 144.21s POT_3 1.000000 0.835938 1.000000 0.898438 1.000000 0.898438 146.18s
POT_4 19.970000 37.257812 6.010000 3.460938 3.650000 1.351562 172.32s POT_4 19.920000 48.257812 8.850000 7.062500 5.640000 3.335938 173.82s
POT_5 17.190000 46.421875 7.760000 3.218750 4.160000 1.492188 236.35s POT_5 17.240000 39.210938 7.990000 7.992188 4.580000 4.210938 240.12s
POT_6 18.690000 37.445312 6.610000 4.101562 4.190000 1.710938 363.53s POT_6 19.120000 35.273438 6.400000 2.781250 4.070000 1.914062 364.37s
POT_7 15.080000 30.570312 6.060000 3.289062 4.120000 1.453125 623.36s POT_7 14.720000 29.867188 6.290000 4.171875 4.470000 2.195312 622.20s
POT_8 20.530000 46.226562 7.880000 3.085938 4.350000 1.320312 1136.85s POT_8 19.890000 38.992188 7.300000 7.117188 5.320000 4.195312 1130.36s
FLOAT_3_E1 0.960000 1.148438 1.040000 1.000000 1.120000 1.156250 145.13s FLOAT_3_E1 0.970000 1.085938 1.110000 1.414062 1.010000 1.125000 147.99s
FLOAT_4_E1 25.630000 39.640625 5.910000 12.218750 5.320000 6.343750 172.46s FLOAT_4_E1 25.700000 42.031250 5.890000 4.382812 4.190000 2.960938 174.74s
FLOAT_4_E2 15.960000 61.335938 3.200000 5.062500 1.720000 2.296875 171.38s FLOAT_4_E2 15.940000 60.531250 3.250000 4.515625 1.750000 2.078125 174.63s
FLOAT_5_E1 53.420000 87.265625 12.640000 15.460938 6.110000 6.203125 234.96s FLOAT_5_E1 53.130000 84.796875 12.260000 18.250000 6.120000 6.734375 239.48s
FLOAT_5_E2 53.880000 98.460938 8.820000 14.609375 4.340000 4.437500 236.93s FLOAT_5_E2 54.070000 98.414062 8.830000 14.187500 4.170000 4.335938 239.34s
FLOAT_5_E3 58.640000 97.812500 15.390000 28.984375 6.130000 7.437500 237.52s FLOAT_5_E3 58.650000 97.843750 14.950000 26.703125 6.030000 7.710938 239.21s
FLOAT_6_E1 59.440000 95.328125 14.160000 20.406250 6.050000 6.578125 363.66s FLOAT_6_E1 59.740000 94.703125 13.890000 18.375000 5.730000 5.976562 364.47s
FLOAT_6_E2 64.600000 99.929688 12.210000 33.445312 5.090000 9.289062 362.85s FLOAT_6_E2 64.360000 99.953125 12.680000 34.570312 5.280000 10.000000 364.26s
FLOAT_6_E3 71.680000 99.992188 18.200000 59.335938 6.320000 15.453125 364.36s FLOAT_6_E3 71.590000 99.976562 18.040000 62.312500 6.110000 16.625000 365.80s
FLOAT_6_E4 58.550000 97.742188 14.810000 27.281250 5.960000 6.929688 363.45s FLOAT_6_E4 58.800000 98.031250 15.630000 29.875000 6.180000 7.492188 364.48s
FLOAT_7_E1 64.430000 97.562500 14.970000 23.359375 6.290000 6.710938 623.47s FLOAT_7_E1 64.470000 97.843750 15.270000 23.929688 6.300000 7.007812 621.05s
FLOAT_7_E2 68.690000 99.984375 14.460000 40.945312 6.280000 11.750000 624.23s FLOAT_7_E2 68.790000 100.000000 14.380000 41.718750 5.640000 11.531250 621.55s
FLOAT_7_E3 74.380000 100.000000 18.630000 68.492188 5.570000 14.820312 624.86s FLOAT_7_E3 74.420000 99.992188 18.410000 68.390625 5.680000 15.046875 622.55s
FLOAT_7_E4 71.490000 99.984375 18.110000 60.945312 6.200000 16.414062 624.94s FLOAT_7_E4 71.500000 99.968750 18.340000 61.757812 6.290000 17.164062 621.68s
FLOAT_7_E5 57.370000 97.765625 15.000000 25.585938 6.150000 7.109375 624.37s FLOAT_7_E5 57.540000 97.773438 15.370000 31.171875 6.180000 7.742188 621.93s
FLOAT_8_E1 65.180000 98.242188 15.500000 25.929688 6.210000 6.851562 1135.77s FLOAT_8_E1 65.260000 98.437500 15.400000 26.929688 6.140000 7.109375 1129.73s
FLOAT_8_E2 69.890000 100.000000 14.170000 45.382812 5.660000 12.070312 1136.86s FLOAT_8_E2 69.850000 99.984375 14.360000 45.687500 5.530000 12.242188 1130.44s
FLOAT_8_E3 75.280000 100.000000 18.200000 70.593750 5.310000 15.242188 1139.26s FLOAT_8_E3 75.240000 100.000000 18.220000 71.500000 5.250000 15.578125 1131.57s
FLOAT_8_E4 74.490000 99.992188 18.470000 68.578125 5.560000 14.664062 1139.00s FLOAT_8_E4 74.360000 100.000000 18.580000 68.710938 5.770000 15.070312 1132.24s
FLOAT_8_E5 71.590000 99.992188 18.130000 60.117188 6.080000 15.929688 1139.45s FLOAT_8_E5 71.630000 99.960938 18.180000 62.000000 5.980000 16.773438 1132.72s
FLOAT_8_E6 59.890000 98.406250 15.390000 28.210938 6.210000 7.296875 1137.74s FLOAT_8_E6 60.120000 97.835938 15.060000 26.562500 6.260000 7.117188 1131.97s
ResNet_18 cifar100 ResNet_18 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 75.730000 93.804688 18.740000 45.265625 4.580000 4.468750 41.64s Full 75.710000 93.687500 18.760000 45.093750 4.570000 3.992188 39.12s
INT_2 1.050000 0.960938 1.000000 0.960938 1.000000 0.960938 85.74s INT_2 1.050000 1.007812 1.000000 1.007812 1.000000 1.007812 107.65s
INT_3 1.110000 1.054688 1.000000 1.093750 1.000000 1.093750 84.06s INT_3 1.110000 1.007812 1.000000 0.984375 1.000000 0.984375 108.99s
INT_4 6.050000 11.140625 1.520000 3.367188 1.170000 2.390625 109.52s INT_4 5.900000 9.070312 1.090000 1.250000 0.900000 1.281250 83.34s
INT_5 50.990000 67.367188 11.260000 27.296875 5.250000 12.703125 108.59s INT_5 50.980000 68.148438 11.570000 27.523438 5.570000 13.171875 109.11s
INT_6 70.680000 90.703125 17.440000 36.882812 6.720000 10.109375 105.91s INT_6 70.930000 90.179688 18.100000 38.890625 6.940000 10.906250 107.55s
INT_7 74.590000 92.890625 17.580000 40.734375 5.410000 7.945312 83.94s INT_7 74.660000 92.476562 17.800000 40.078125 5.480000 7.593750 108.09s
INT_8 75.350000 93.460938 18.290000 43.820312 5.280000 6.593750 83.70s INT_8 75.390000 93.085938 18.520000 43.648438 5.270000 6.054688 107.82s
INT_9 75.300000 93.265625 18.600000 44.914062 5.160000 6.023438 87.10s INT_9 75.260000 92.898438 18.590000 44.101562 5.170000 5.632812 107.63s
INT_10 75.480000 93.523438 18.440000 45.007812 5.110000 5.562500 108.09s INT_10 75.520000 93.000000 18.680000 44.414062 5.060000 5.343750 108.56s
INT_11 75.390000 93.476562 18.380000 44.750000 5.070000 5.585938 111.52s INT_11 75.430000 93.023438 18.480000 44.171875 5.010000 5.265625 108.60s
INT_12 75.490000 93.640625 18.610000 45.195312 5.010000 5.390625 108.93s INT_12 75.510000 93.351562 18.530000 44.781250 4.920000 4.992188 107.05s
INT_13 75.380000 93.476562 18.490000 45.015625 4.950000 5.570312 96.75s INT_13 75.400000 93.093750 18.480000 44.578125 5.020000 5.250000 109.86s
INT_14 75.380000 93.476562 18.490000 45.039062 4.960000 5.562500 109.07s INT_14 75.380000 93.070312 18.530000 44.421875 4.980000 5.250000 89.74s
INT_15 75.440000 93.546875 18.550000 45.156250 4.930000 5.507812 109.48s INT_15 75.430000 93.234375 18.530000 44.656250 5.020000 5.195312 107.04s
INT_16 75.380000 93.429688 18.470000 44.898438 5.030000 5.687500 108.75s INT_16 75.380000 92.992188 18.530000 44.320312 5.010000 5.296875 107.90s
POT_2 1.000000 0.960938 1.000000 0.960938 1.000000 0.960938 131.52s POT_2 1.000000 1.007812 1.000000 1.007812 1.000000 1.007812 131.51s
POT_3 1.000000 1.765625 1.030000 1.242188 0.990000 1.125000 147.38s POT_3 1.000000 1.492188 1.000000 0.984375 1.000000 0.984375 141.68s
POT_4 20.070000 25.234375 7.270000 4.390625 3.850000 3.218750 176.41s POT_4 19.920000 18.898438 4.550000 4.289062 3.750000 3.367188 171.54s
POT_5 17.150000 23.843750 5.450000 4.718750 3.950000 3.031250 241.32s POT_5 17.240000 21.570312 5.110000 4.890625 3.670000 3.312500 237.89s
POT_6 18.800000 25.750000 6.280000 6.242188 4.340000 4.000000 367.15s POT_6 19.120000 23.476562 5.370000 5.250000 4.000000 3.750000 362.76s
POT_7 15.320000 23.148438 6.150000 4.093750 4.200000 3.007812 626.71s POT_7 14.720000 22.890625 6.800000 6.242188 4.340000 3.570312 621.20s
POT_8 20.980000 23.523438 6.420000 5.703125 4.200000 3.703125 1138.57s POT_8 19.890000 22.312500 5.330000 5.859375 3.520000 4.085938 1130.16s
FLOAT_3_E1 0.960000 1.140625 1.080000 1.015625 0.810000 1.085938 145.22s FLOAT_3_E1 0.970000 1.062500 0.940000 0.953125 0.870000 0.906250 143.89s
FLOAT_4_E1 25.430000 16.085938 6.060000 5.187500 3.970000 3.531250 176.01s FLOAT_4_E1 25.700000 11.687500 4.180000 3.515625 3.230000 2.828125 171.92s
FLOAT_4_E2 16.120000 31.812500 1.930000 4.054688 1.170000 2.304688 174.85s FLOAT_4_E2 15.940000 29.468750 1.810000 3.195312 1.440000 2.507812 175.94s
FLOAT_5_E1 52.850000 48.109375 11.740000 11.757812 6.430000 7.585938 241.36s FLOAT_5_E1 53.130000 49.656250 13.430000 24.179688 6.770000 11.726562 238.38s
FLOAT_5_E2 54.290000 75.695312 9.530000 11.234375 4.940000 3.421875 240.09s FLOAT_5_E2 54.070000 75.671875 9.380000 12.953125 4.790000 3.789062 238.00s
FLOAT_5_E3 58.550000 77.734375 15.420000 25.593750 6.730000 12.265625 239.32s FLOAT_5_E3 58.650000 77.054688 15.660000 25.515625 6.710000 9.593750 238.18s
FLOAT_6_E1 59.440000 64.679688 14.050000 21.218750 6.450000 9.937500 366.27s FLOAT_6_E1 59.740000 65.023438 13.960000 20.656250 6.480000 9.593750 363.44s
FLOAT_6_E2 64.250000 87.062500 12.510000 26.875000 5.470000 8.468750 367.72s FLOAT_6_E2 64.360000 86.031250 12.570000 26.250000 5.540000 8.218750 363.48s
FLOAT_6_E3 71.590000 90.867188 18.400000 36.000000 6.360000 6.203125 368.44s FLOAT_6_E3 71.590000 90.023438 18.690000 35.148438 6.360000 5.570312 363.64s
FLOAT_6_E4 58.480000 77.101562 15.430000 26.312500 6.730000 11.984375 367.47s FLOAT_6_E4 58.800000 78.101562 15.550000 24.921875 6.870000 9.304688 363.61s
FLOAT_7_E1 64.330000 74.210938 14.460000 28.000000 6.290000 12.523438 626.82s FLOAT_7_E1 64.470000 72.093750 14.560000 24.882812 6.180000 10.921875 621.38s
FLOAT_7_E2 68.740000 89.718750 15.260000 34.421875 6.390000 10.593750 628.45s FLOAT_7_E2 68.790000 88.257812 14.980000 32.039062 6.410000 9.187500 621.99s
FLOAT_7_E3 74.330000 92.421875 18.450000 42.718750 5.490000 7.554688 627.38s FLOAT_7_E3 74.420000 92.218750 18.630000 42.023438 5.590000 7.132812 622.31s
FLOAT_7_E4 71.460000 90.453125 18.310000 35.320312 6.390000 6.328125 627.53s FLOAT_7_E4 71.500000 90.007812 18.570000 35.000000 6.310000 5.734375 622.45s
FLOAT_7_E5 57.240000 77.351562 15.610000 26.500000 6.520000 11.929688 627.83s FLOAT_7_E5 57.540000 77.640625 15.670000 25.695312 6.550000 8.968750 622.14s
FLOAT_8_E1 65.190000 75.515625 14.840000 28.757812 6.210000 12.234375 1139.52s FLOAT_8_E1 65.260000 74.156250 14.870000 27.648438 6.050000 11.460938 1130.47s
FLOAT_8_E2 69.840000 90.054688 15.180000 33.796875 6.320000 9.906250 1139.23s FLOAT_8_E2 69.850000 89.148438 15.310000 33.554688 6.270000 9.648438 1130.45s
FLOAT_8_E3 75.230000 93.218750 18.350000 44.781250 5.180000 6.203125 1140.96s FLOAT_8_E3 75.240000 92.890625 18.320000 44.125000 5.220000 5.742188 1131.85s
FLOAT_8_E4 74.400000 92.492188 18.440000 42.757812 5.540000 7.664062 1137.38s FLOAT_8_E4 74.360000 91.898438 18.570000 42.554688 5.590000 7.289062 1131.98s
FLOAT_8_E5 71.530000 90.710938 18.720000 34.914062 6.320000 6.007812 1138.86s FLOAT_8_E5 71.630000 89.632812 18.640000 35.046875 6.590000 5.664062 1131.69s
FLOAT_8_E6 60.140000 79.359375 15.510000 30.039062 6.600000 12.195312 1140.52s FLOAT_8_E6 60.120000 76.250000 15.710000 24.835938 6.410000 9.007812 1131.35s
ResNet_50 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 77.220000 99.992188 21.840000 70.609375 4.630000 32.945312 134.37s
INT_2 1.000000 0.968750 1.000000 0.968750 1.000000 0.968750 271.30s
ResNet_50 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 77.220000 99.132812 21.780000 31.367188 4.670000 6.640625 136.84s
INT_2 1.000000 0.937500 1.000000 0.937500 1.000000 0.937500 303.64s
INT_3 0.920000 1.054688 1.010000 0.937500 1.000000 0.929688 303.65s
INT_4 2.420000 2.031250 1.450000 1.476562 1.350000 1.664062 301.80s
INT_5 48.050000 43.640625 10.050000 10.281250 6.550000 7.070312 303.93s
INT_6 73.510000 94.148438 20.730000 26.085938 9.050000 11.390625 305.02s
INT_7 76.470000 98.328125 21.960000 31.796875 6.360000 10.234375 323.21s
INT_8 77.070000 99.000000 22.140000 32.585938 5.850000 8.390625 302.66s
INT_9 77.050000 99.210938 21.200000 30.726562 4.850000 6.929688 302.51s
INT_10 77.220000 99.179688 21.770000 31.453125 4.650000 6.789062 302.09s
INT_11 77.310000 99.187500 21.550000 31.273438 4.690000 6.734375 301.55s
INT_12 77.310000 99.171875 21.530000 31.203125 4.600000 6.601562 302.14s
INT_13 77.240000 99.148438 21.770000 31.359375 4.590000 6.617188 301.25s
INT_14 77.200000 99.156250 21.660000 31.390625 4.560000 6.601562 301.95s
INT_15 77.270000 99.156250 21.760000 31.382812 4.610000 6.640625 301.44s
INT_16 77.280000 99.156250 21.760000 31.437500 4.600000 6.687500 303.16s
POT_2 1.000000 0.937500 1.000000 0.937500 1.000000 0.937500 482.86s
POT_3 1.140000 0.500000 0.970000 0.820312 0.910000 0.804688 569.16s
POT_4 8.170000 8.835938 2.390000 2.539062 1.840000 1.867188 755.91s
POT_5 10.740000 9.390625 3.180000 3.500000 2.290000 2.820312 1132.30s
POT_6 9.270000 9.546875 3.880000 4.171875 2.660000 2.765625 1867.75s
POT_7 9.590000 8.953125 2.890000 3.562500 2.140000 2.671875 3361.40s
POT_8 10.090000 8.140625 3.150000 3.843750 2.290000 3.203125 6302.82s
FLOAT_3_E1 1.100000 0.281250 0.940000 0.531250 0.790000 0.664062 569.40s
FLOAT_4_E1 4.000000 3.437500 2.120000 1.562500 1.720000 1.554688 755.81s
FLOAT_4_E2 4.390000 4.648438 1.260000 1.500000 1.220000 1.296875 755.53s
FLOAT_5_E1 39.440000 30.390625 6.530000 5.750000 4.380000 3.500000 1127.41s
FLOAT_5_E2 45.730000 27.015625 6.440000 6.593750 4.020000 3.898438 1129.92s
FLOAT_5_E3 60.730000 64.671875 17.000000 20.867188 7.690000 9.062500 1130.52s
FLOAT_6_E1 60.710000 52.656250 12.840000 14.976562 6.310000 7.210938 1855.33s
FLOAT_6_E2 66.960000 72.148438 14.620000 17.562500 5.940000 7.554688 1857.89s
FLOAT_6_E3 72.560000 95.757812 22.420000 30.859375 7.790000 10.335938 1864.54s
FLOAT_6_E4 59.760000 67.070312 17.480000 22.093750 7.590000 10.125000 1866.11s
FLOAT_7_E1 63.380000 60.484375 13.910000 17.164062 6.240000 6.875000 3340.88s
FLOAT_7_E2 70.830000 88.687500 15.820000 20.070312 5.310000 7.851562 3347.68s
FLOAT_7_E3 75.770000 98.539062 22.020000 32.515625 6.150000 8.898438 3357.02s
FLOAT_7_E4 72.950000 95.960938 22.150000 30.312500 7.720000 10.164062 3361.56s
FLOAT_7_E5 60.230000 69.492188 15.980000 17.250000 8.280000 9.531250 3356.06s
FLOAT_8_E1 64.680000 63.632812 14.060000 20.242188 6.160000 7.812500 6270.18s
FLOAT_8_E2 72.490000 91.929688 16.360000 22.257812 5.140000 7.773438 6275.41s
FLOAT_8_E3 76.940000 98.992188 21.400000 31.507812 5.370000 7.562500 6290.97s
FLOAT_8_E4 76.020000 98.617188 22.130000 32.976562 6.240000 9.421875 6365.28s
FLOAT_8_E5 72.550000 96.226562 22.810000 31.570312 7.820000 10.718750 6367.75s
FLOAT_8_E6 57.690000 65.460938 17.750000 22.460938 7.850000 10.148438 6369.97s
VGG_16 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 71.120000 99.992188 23.750000 47.828125 6.390000 9.953125 28.60s
INT_2 1.000000 0.898438 1.000000 0.898438 1.000000 0.898438 70.96s
INT_3 1.000000 1.078125 1.000000 1.109375 1.000000 1.109375 70.62s
INT_4 14.320000 32.085938 5.350000 6.828125 3.450000 4.609375 71.19s
INT_5 54.840000 97.523438 15.080000 29.562500 7.400000 14.531250 71.03s
INT_6 69.100000 99.937500 21.370000 42.945312 7.090000 14.343750 70.99s
INT_7 70.570000 100.000000 24.390000 48.062500 7.490000 12.507812 70.80s
INT_8 70.980000 100.000000 24.010000 47.859375 6.680000 11.085938 70.85s
INT_9 71.040000 99.992188 23.710000 47.781250 6.580000 10.421875 70.95s
INT_10 71.110000 99.992188 23.700000 47.617188 6.450000 10.195312 71.05s
INT_11 71.170000 99.992188 23.620000 47.734375 6.390000 9.976562 71.11s
INT_12 71.120000 99.992188 23.640000 47.718750 6.370000 9.953125 71.03s
INT_13 71.090000 99.992188 23.700000 47.734375 6.410000 9.929688 71.07s
INT_14 71.120000 99.992188 23.690000 47.718750 6.390000 9.968750 70.41s
INT_15 71.120000 99.992188 23.720000 47.695312 6.410000 9.945312 71.04s
INT_16 71.120000 99.992188 23.730000 47.750000 6.370000 9.921875 70.93s
POT_2 1.000000 0.898438 1.000000 0.898438 1.000000 0.898438 111.07s
POT_3 1.230000 1.265625 1.240000 1.140625 1.170000 0.953125 112.19s
POT_4 29.560000 51.085938 10.820000 10.812500 5.360000 5.515625 122.72s
POT_5 29.570000 50.578125 10.290000 10.304688 5.280000 5.390625 156.89s
POT_6 29.780000 51.054688 10.500000 10.171875 5.460000 5.250000 228.81s
POT_7 28.930000 52.195312 10.360000 10.031250 5.260000 5.039062 380.37s
POT_8 29.640000 50.828125 10.760000 9.710938 5.310000 4.906250 681.62s
FLOAT_3_E1 1.360000 1.507812 1.330000 1.148438 1.130000 1.187500 112.12s
FLOAT_4_E1 19.990000 22.031250 6.320000 6.976562 3.140000 4.093750 123.53s
FLOAT_4_E2 41.460000 83.117188 9.960000 20.023438 6.040000 12.890625 123.38s
FLOAT_5_E1 52.400000 76.437500 13.580000 18.203125 5.770000 8.476562 156.67s
FLOAT_5_E2 63.350000 99.718750 22.510000 42.859375 9.570000 19.460938 156.82s
FLOAT_5_E3 61.910000 99.367188 20.810000 35.250000 7.640000 12.765625 156.90s
FLOAT_6_E1 58.050000 89.156250 16.730000 23.960938 6.440000 9.000000 228.55s
FLOAT_6_E2 67.760000 100.000000 23.430000 46.125000 9.280000 16.968750 228.60s
FLOAT_6_E3 69.150000 99.953125 23.700000 44.570312 7.400000 11.554688 228.58s
FLOAT_6_E4 61.580000 99.390625 21.250000 34.937500 7.510000 12.554688 228.82s
FLOAT_7_E1 61.250000 95.093750 17.420000 25.750000 6.070000 8.718750 379.30s
FLOAT_7_E2 68.340000 99.992188 23.250000 46.750000 8.450000 15.328125 379.27s
FLOAT_7_E3 70.690000 99.992188 23.750000 47.195312 6.870000 10.781250 379.62s
FLOAT_7_E4 68.930000 99.960938 23.690000 44.648438 7.350000 11.406250 380.33s
FLOAT_7_E5 61.440000 99.367188 20.620000 34.765625 7.440000 12.585938 379.90s
FLOAT_8_E1 62.520000 96.531250 18.150000 27.304688 6.410000 9.031250 679.70s
FLOAT_8_E2 69.330000 99.984375 23.650000 47.367188 8.280000 14.859375 679.90s
FLOAT_8_E3 71.150000 99.992188 23.740000 47.921875 6.540000 10.210938 680.70s
FLOAT_8_E4 70.760000 99.992188 23.800000 46.867188 6.810000 10.734375 680.79s
FLOAT_8_E5 68.970000 99.960938 23.790000 44.507812 7.270000 11.632812 681.29s
FLOAT_8_E6 61.640000 99.296875 20.440000 34.945312 7.620000 12.460938 681.54s
VGG_16 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 71.120000 74.757812 23.680000 21.070312 6.390000 7.945312 28.71s
INT_2 1.000000 0.921875 1.000000 0.921875 1.000000 0.921875 72.79s
INT_3 0.990000 0.929688 1.000000 0.953125 1.000000 0.953125 72.65s
INT_4 14.950000 8.078125 4.410000 4.078125 2.990000 3.031250 73.32s
INT_5 54.950000 33.445312 14.540000 15.906250 7.340000 10.164062 72.54s
INT_6 69.380000 64.937500 21.000000 20.109375 7.190000 10.023438 72.85s
INT_7 70.660000 72.539062 24.310000 20.601562 7.540000 9.007812 73.13s
INT_8 71.010000 74.429688 23.970000 21.070312 6.750000 8.562500 72.78s
INT_9 71.060000 74.492188 23.810000 20.945312 6.470000 8.171875 72.88s
INT_10 71.110000 74.523438 23.770000 20.984375 6.440000 8.085938 72.99s
INT_11 71.150000 74.679688 23.640000 21.085938 6.400000 7.960938 72.68s
INT_12 71.150000 74.734375 23.690000 21.007812 6.420000 8.070312 73.20s
INT_13 71.120000 74.734375 23.760000 21.093750 6.420000 8.046875 72.87s
INT_14 71.140000 74.718750 23.610000 21.046875 6.370000 7.984375 72.80s
INT_15 71.120000 74.789062 23.700000 21.046875 6.420000 7.976562 73.13s
INT_16 71.120000 74.757812 23.700000 21.023438 6.360000 8.007812 73.30s
POT_2 1.000000 0.921875 1.000000 0.921875 1.000000 0.921875 113.07s
POT_3 1.200000 1.328125 1.040000 1.039062 1.210000 0.968750 113.22s
POT_4 29.670000 28.359375 10.130000 4.054688 5.330000 2.765625 124.62s
POT_5 29.300000 27.820312 10.010000 3.765625 5.140000 2.515625 158.91s
POT_6 29.590000 28.000000 10.120000 3.773438 5.300000 2.671875 231.04s
POT_7 29.200000 27.789062 10.150000 3.804688 5.280000 2.593750 382.51s
POT_8 29.420000 27.156250 10.180000 3.781250 5.320000 2.500000 683.47s
FLOAT_3_E1 1.350000 1.226562 1.280000 0.804688 1.300000 0.914062 114.22s
FLOAT_4_E1 19.850000 11.632812 6.520000 3.906250 3.940000 2.992188 124.93s
FLOAT_4_E2 41.260000 20.109375 9.160000 9.773438 5.380000 7.257812 124.81s
FLOAT_5_E1 51.850000 33.054688 13.640000 6.875000 5.970000 4.257812 158.98s
FLOAT_5_E2 63.260000 42.367188 21.310000 15.984375 9.910000 9.429688 158.71s
FLOAT_5_E3 61.820000 59.562500 20.840000 15.406250 7.520000 9.101562 158.82s
FLOAT_6_E1 58.080000 41.703125 16.590000 8.742188 6.310000 4.867188 230.93s
FLOAT_6_E2 68.060000 61.140625 22.810000 19.039062 8.550000 9.921875 231.18s
FLOAT_6_E3 69.180000 67.476562 23.990000 19.578125 7.410000 8.460938 231.25s
FLOAT_6_E4 61.470000 59.851562 20.790000 15.484375 7.600000 8.562500 231.31s
FLOAT_7_E1 61.210000 47.265625 17.360000 10.195312 6.210000 5.171875 381.74s
FLOAT_7_E2 68.430000 63.726562 23.200000 19.171875 8.130000 9.445312 381.62s
FLOAT_7_E3 70.730000 74.570312 23.990000 21.585938 6.800000 8.718750 382.08s
FLOAT_7_E4 69.080000 67.484375 23.700000 19.492188 7.410000 8.570312 382.22s
FLOAT_7_E5 61.500000 59.867188 20.750000 15.351562 7.530000 8.632812 382.32s
FLOAT_8_E1 62.530000 50.742188 18.070000 11.070312 6.160000 5.218750 681.46s
FLOAT_8_E2 69.270000 65.140625 23.260000 19.148438 7.800000 9.078125 681.67s
FLOAT_8_E3 71.170000 74.101562 23.700000 21.226562 6.500000 8.257812 682.69s
FLOAT_8_E4 70.720000 74.617188 23.820000 21.523438 6.770000 8.757812 683.04s
FLOAT_8_E5 68.880000 67.375000 23.760000 19.554688 7.320000 8.554688 683.31s
FLOAT_8_E6 61.550000 59.523438 20.780000 15.632812 7.490000 8.796875 683.54s
VGG_19 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 70.450000 99.992188 26.070000 24.867188 6.150000 1.539062 51.09s
INT_2 1.000000 0.859375 1.000000 0.859375 1.000000 0.859375 94.24s
INT_3 0.990000 1.210938 1.000000 1.007812 1.000000 1.007812 94.29s
INT_4 8.620000 4.031250 2.770000 1.937500 1.870000 1.703125 88.31s
INT_5 51.640000 71.742188 14.780000 8.523438 6.780000 3.414062 84.84s
INT_6 67.900000 99.679688 24.140000 21.406250 7.610000 4.203125 92.78s
INT_7 69.920000 99.945312 25.680000 24.921875 6.810000 2.390625 86.22s
INT_8 70.530000 99.976562 25.910000 25.031250 6.640000 1.875000 84.76s
INT_9 70.420000 99.992188 26.130000 25.117188 6.420000 1.695312 93.57s
INT_10 70.450000 99.992188 26.060000 24.609375 6.260000 1.546875 91.39s
INT_11 70.460000 99.992188 25.960000 24.914062 6.210000 1.570312 94.97s
INT_12 70.460000 99.992188 26.060000 25.039062 6.140000 1.531250 90.26s
INT_13 70.440000 99.992188 25.980000 24.757812 6.110000 1.562500 86.54s
INT_14 70.440000 99.992188 26.060000 24.859375 6.210000 1.531250 85.10s
INT_15 70.450000 99.992188 26.080000 24.875000 6.210000 1.546875 85.30s
INT_16 70.450000 99.992188 26.120000 24.843750 6.170000 1.531250 95.44s
POT_2 1.000000 0.859375 1.000000 0.859375 1.000000 0.859375 127.35s
POT_3 1.150000 1.023438 0.880000 1.039062 1.020000 0.851562 142.24s
POT_4 28.630000 20.164062 7.940000 3.882812 3.800000 1.250000 167.23s
POT_5 28.360000 20.000000 7.490000 3.789062 3.530000 1.375000 220.04s
POT_6 28.820000 20.101562 7.760000 3.492188 3.500000 1.281250 324.49s
POT_7 28.810000 20.007812 7.610000 3.960938 3.470000 1.296875 543.20s
POT_8 27.970000 19.726562 7.550000 3.953125 3.340000 1.468750 959.05s
FLOAT_3_E1 1.080000 1.414062 0.940000 0.984375 0.890000 0.937500 139.10s
FLOAT_4_E1 25.430000 9.117188 7.520000 3.617188 3.540000 1.648438 166.84s
FLOAT_4_E2 39.180000 48.062500 10.940000 7.515625 5.920000 4.039062 167.05s
FLOAT_5_E1 49.600000 42.218750 15.860000 6.742188 5.900000 1.671875 219.84s
FLOAT_5_E2 60.360000 94.710938 20.500000 15.937500 7.980000 4.750000 220.06s
FLOAT_5_E3 61.780000 94.171875 21.710000 14.984375 7.110000 2.898438 220.06s
FLOAT_6_E1 56.550000 59.343750 16.890000 8.648438 5.340000 1.312500 325.88s
FLOAT_6_E2 66.160000 99.382812 22.680000 19.695312 7.250000 3.320312 325.75s
FLOAT_6_E3 68.390000 99.804688 26.590000 26.601562 7.680000 2.437500 326.61s
FLOAT_6_E4 61.840000 94.007812 21.910000 15.398438 7.300000 2.882812 326.43s
FLOAT_7_E1 59.380000 68.835938 18.700000 9.585938 5.430000 1.304688 543.78s
FLOAT_7_E2 67.790000 99.648438 24.290000 23.882812 7.440000 3.281250 544.17s
FLOAT_7_E3 69.990000 99.953125 25.740000 24.726562 6.600000 2.070312 543.13s
FLOAT_7_E4 68.500000 99.843750 26.220000 26.453125 7.660000 2.437500 543.96s
FLOAT_7_E5 61.970000 94.132812 21.450000 15.007812 7.230000 2.984375 544.08s
FLOAT_8_E1 60.920000 74.515625 19.090000 9.539062 5.270000 1.179688 959.50s
FLOAT_8_E2 68.490000 99.812500 24.280000 22.304688 6.960000 2.773438 958.64s
FLOAT_8_E3 70.550000 99.984375 26.050000 26.195312 6.460000 1.851562 959.14s
FLOAT_8_E4 69.900000 99.968750 25.770000 24.656250 6.740000 1.937500 968.30s
FLOAT_8_E5 68.510000 99.789062 26.340000 26.687500 7.750000 2.445312 974.85s
FLOAT_8_E6 61.740000 93.906250 21.530000 15.359375 7.130000 3.039062 974.98s
VGG_19 cifar100
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 70.450000 67.390625 26.070000 33.445312 6.180000 5.976562 52.83s
INT_2 1.000000 1.062500 1.000000 1.062500 1.000000 1.062500 92.84s
INT_3 0.990000 1.054688 1.000000 0.937500 1.000000 0.976562 95.06s
INT_4 8.620000 2.828125 2.240000 1.687500 1.500000 1.515625 90.31s
INT_5 51.640000 24.937500 13.610000 19.125000 6.790000 10.656250 94.06s
INT_6 67.900000 50.960938 25.260000 30.859375 8.220000 9.804688 96.73s
INT_7 69.920000 62.484375 25.350000 32.195312 6.760000 7.515625 90.20s
INT_8 70.530000 65.757812 26.210000 33.570312 6.730000 6.531250 92.30s
INT_9 70.420000 67.117188 25.990000 33.742188 6.350000 6.140625 90.17s
INT_10 70.450000 67.062500 26.030000 33.593750 6.200000 6.046875 95.58s
INT_11 70.460000 67.320312 26.040000 33.476562 6.200000 5.992188 90.22s
INT_12 70.460000 67.320312 26.090000 33.375000 6.160000 5.937500 91.48s
INT_13 70.440000 67.390625 26.030000 33.398438 6.180000 5.921875 101.19s
INT_14 70.440000 67.359375 26.080000 33.398438 6.170000 5.929688 94.17s
INT_15 70.450000 67.375000 26.010000 33.382812 6.200000 5.937500 94.46s
INT_16 70.450000 67.390625 26.100000 33.476562 6.190000 6.000000 90.39s
POT_2 1.000000 1.062500 1.000000 1.062500 1.000000 1.062500 130.52s
POT_3 1.150000 0.992188 0.940000 0.789062 1.060000 0.796875 142.72s
POT_4 28.630000 21.351562 8.910000 10.117188 3.870000 6.539062 168.07s
POT_5 28.360000 20.460938 8.770000 9.882812 3.760000 6.359375 223.23s
POT_6 28.820000 20.921875 8.840000 9.625000 3.980000 6.335938 328.64s
POT_7 28.810000 20.796875 9.090000 9.781250 3.870000 6.445312 546.07s
POT_8 27.970000 20.710938 8.580000 9.617188 3.890000 6.359375 961.30s
FLOAT_3_E1 1.080000 0.859375 1.090000 1.101562 0.920000 0.828125 142.01s
FLOAT_4_E1 25.430000 15.054688 8.540000 7.937500 4.130000 4.398438 166.07s
FLOAT_4_E2 39.180000 20.750000 7.990000 11.851562 4.690000 6.609375 168.19s
FLOAT_5_E1 49.600000 32.304688 17.030000 16.195312 6.800000 9.773438 221.54s
FLOAT_5_E2 60.360000 37.914062 19.790000 22.195312 7.620000 12.351562 220.26s
FLOAT_5_E3 61.780000 49.953125 21.110000 19.765625 6.700000 4.898438 222.36s
FLOAT_6_E1 56.550000 37.406250 17.510000 17.296875 6.030000 8.945312 327.31s
FLOAT_6_E2 66.160000 51.554688 23.090000 28.054688 7.090000 8.562500 327.50s
FLOAT_6_E3 68.390000 60.546875 26.230000 31.625000 7.380000 12.195312 327.79s
FLOAT_6_E4 61.840000 50.132812 21.120000 19.960938 6.840000 4.929688 326.62s
FLOAT_7_E1 59.380000 42.117188 19.400000 20.648438 6.310000 10.554688 545.81s
FLOAT_7_E2 67.790000 55.335938 23.760000 29.968750 7.340000 7.578125 545.65s
FLOAT_7_E3 69.990000 65.164062 25.740000 33.296875 6.630000 6.570312 545.62s
FLOAT_7_E4 68.500000 60.179688 26.200000 32.132812 7.440000 12.296875 546.02s
FLOAT_7_E5 61.970000 50.109375 21.150000 19.695312 6.860000 4.796875 545.76s
FLOAT_8_E1 60.920000 44.015625 19.400000 19.703125 6.070000 9.679688 960.30s
FLOAT_8_E2 68.490000 55.914062 24.120000 30.046875 6.930000 7.382812 961.54s
FLOAT_8_E3 70.550000 66.906250 26.100000 33.250000 6.370000 6.085938 960.89s
FLOAT_8_E4 69.900000 65.226562 25.710000 33.203125 6.570000 6.546875 960.59s
FLOAT_8_E5 68.510000 60.125000 26.300000 31.750000 7.480000 11.890625 961.26s
FLOAT_8_E6 61.740000 49.648438 21.380000 19.640625 6.830000 4.859375 961.81s
AlexNet cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 88.640000 99.726562 45.340000 60.039062 19.860000 34.625000 12.48s
INT_2 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 27.51s
INT_3 10.120000 12.867188 10.000000 9.859375 10.000000 9.859375 28.69s
INT_4 55.640000 61.656250 13.900000 24.125000 11.280000 18.562500 24.35s
INT_5 82.880000 97.656250 37.790000 47.492188 29.120000 39.851562 29.08s
INT_6 87.300000 99.601562 44.420000 57.523438 30.590000 44.406250 28.29s
INT_7 88.230000 99.687500 44.040000 64.289062 25.940000 45.078125 26.63s
INT_8 88.450000 99.750000 45.230000 60.523438 23.230000 38.359375 29.04s
INT_9 88.630000 99.703125 45.200000 60.445312 21.140000 35.984375 26.95s
INT_10 88.700000 99.726562 45.230000 59.882812 20.510000 35.289062 26.87s
INT_11 88.660000 99.726562 45.250000 60.046875 20.100000 34.851562 25.40s
INT_12 88.660000 99.734375 45.260000 60.109375 19.830000 34.804688 26.59s
INT_13 88.630000 99.726562 45.250000 60.039062 19.860000 34.640625 28.14s
INT_14 88.630000 99.726562 45.230000 59.992188 19.820000 34.687500 28.48s
INT_15 88.620000 99.726562 45.390000 60.000000 19.920000 34.617188 26.30s
INT_16 88.630000 99.726562 45.350000 60.039062 19.840000 34.679688 26.49s
POT_2 10.000000 10.101562 10.000000 10.101562 10.000000 10.101562 37.71s
POT_3 16.660000 22.515625 10.010000 9.859375 10.000000 9.859375 38.29s
POT_4 69.810000 93.085938 28.190000 31.140625 17.220000 22.968750 44.90s
POT_5 69.760000 94.015625 27.550000 30.828125 15.820000 22.289062 53.51s
POT_6 70.680000 93.789062 27.980000 29.921875 15.690000 22.023438 74.98s
POT_7 70.320000 94.070312 28.060000 30.867188 15.880000 22.164062 118.00s
POT_8 69.810000 93.976562 27.690000 30.664062 15.670000 22.210938 201.64s
FLOAT_3_E1 23.220000 27.843750 14.160000 22.140625 11.230000 17.406250 38.73s
FLOAT_4_E1 68.120000 91.484375 23.850000 34.398438 17.930000 27.429688 44.20s
FLOAT_4_E2 66.360000 85.289062 24.400000 34.234375 20.050000 31.000000 43.02s
FLOAT_5_E1 79.430000 98.726562 29.100000 47.679688 18.930000 33.992188 54.85s
FLOAT_5_E2 84.020000 97.804688 37.570000 55.046875 24.200000 39.953125 54.37s
FLOAT_5_E3 85.030000 99.250000 39.370000 55.171875 19.650000 32.359375 54.10s
FLOAT_6_E1 83.350000 98.812500 32.690000 61.523438 18.640000 41.695312 75.39s
FLOAT_6_E2 87.150000 99.632812 40.570000 50.257812 22.020000 32.414062 75.66s
FLOAT_6_E3 87.980000 99.648438 44.120000 67.335938 20.330000 39.570312 75.61s
FLOAT_6_E4 85.250000 99.250000 39.030000 53.781250 19.680000 31.476562 75.94s
FLOAT_7_E1 85.030000 99.195312 35.290000 68.187500 17.640000 45.750000 118.53s
FLOAT_7_E2 87.490000 99.750000 41.860000 48.734375 20.750000 28.445312 118.74s
FLOAT_7_E3 88.610000 99.765625 44.980000 59.601562 19.960000 35.289062 118.59s
FLOAT_7_E4 88.090000 99.671875 43.810000 67.312500 20.060000 39.593750 118.47s
FLOAT_7_E5 85.270000 99.296875 39.270000 53.632812 19.510000 31.132812 118.94s
FLOAT_8_E1 86.080000 99.320312 36.530000 69.195312 17.620000 45.312500 202.51s
FLOAT_8_E2 87.870000 99.640625 41.830000 47.335938 19.320000 26.867188 202.51s
FLOAT_8_E3 88.730000 99.757812 44.970000 60.351562 19.860000 35.195312 202.19s
FLOAT_8_E4 88.630000 99.781250 44.840000 59.601562 19.950000 34.890625 202.12s
FLOAT_8_E5 88.150000 99.648438 44.280000 67.242188 20.160000 39.281250 202.64s
FLOAT_8_E6 85.200000 99.281250 38.980000 53.492188 19.830000 30.859375 202.72s
AlexNet_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.130000 99.843750 48.620000 64.164062 19.220000 23.390625 14.21s
INT_2 10.000000 9.796875 10.000000 9.796875 10.000000 9.796875 28.30s
INT_3 14.040000 16.929688 10.000000 9.796875 10.000000 9.796875 31.25s
INT_4 48.760000 62.328125 15.280000 17.804688 13.540000 15.468750 35.92s
INT_5 76.310000 96.093750 23.750000 32.851562 16.270000 23.593750 28.12s
INT_6 88.910000 99.375000 43.970000 65.976562 24.860000 43.390625 31.49s
INT_7 89.790000 99.875000 47.430000 65.625000 24.060000 32.945312 33.04s
INT_8 90.240000 99.828125 47.930000 65.617188 21.380000 28.531250 34.08s
INT_9 90.070000 99.835938 48.230000 64.531250 20.100000 24.960938 31.51s
INT_10 90.100000 99.843750 48.380000 64.101562 19.560000 24.078125 31.64s
INT_11 90.120000 99.843750 48.360000 64.320312 19.390000 23.601562 30.91s
INT_12 90.160000 99.843750 48.490000 63.929688 19.300000 23.343750 33.59s
INT_13 90.140000 99.843750 48.490000 64.062500 19.200000 23.414062 37.41s
INT_14 90.130000 99.843750 48.550000 64.062500 19.200000 23.320312 34.77s
INT_15 90.140000 99.843750 48.650000 64.125000 19.310000 23.312500 34.93s
INT_16 90.130000 99.843750 48.610000 64.179688 19.170000 23.242188 27.59s
POT_2 10.000000 9.796875 10.000000 9.796875 10.000000 9.796875 40.82s
POT_3 17.480000 21.945312 10.930000 17.320312 10.470000 16.445312 39.56s
POT_4 74.750000 94.773438 28.570000 30.968750 16.050000 20.554688 46.32s
POT_5 74.280000 95.609375 30.290000 34.664062 16.780000 23.367188 56.10s
POT_6 74.770000 94.875000 30.550000 32.242188 17.040000 21.546875 77.70s
POT_7 74.510000 94.929688 30.430000 32.617188 16.910000 21.593750 120.50s
POT_8 74.440000 94.882812 30.590000 32.570312 17.060000 21.695312 203.68s
FLOAT_3_E1 23.080000 29.265625 10.980000 12.031250 10.450000 9.218750 40.04s
FLOAT_4_E1 68.200000 85.187500 20.790000 39.726562 14.550000 26.523438 46.18s
FLOAT_4_E2 72.840000 75.398438 24.180000 25.703125 18.250000 14.500000 46.47s
FLOAT_5_E1 82.640000 97.960938 33.660000 37.171875 19.340000 21.437500 56.24s
FLOAT_5_E2 85.490000 97.875000 39.450000 52.281250 22.870000 36.187500 56.42s
FLOAT_5_E3 87.690000 99.500000 44.720000 39.648438 22.760000 8.898438 55.78s
FLOAT_6_E1 85.790000 98.984375 40.120000 41.929688 20.980000 20.867188 77.81s
FLOAT_6_E2 87.740000 99.203125 42.470000 58.515625 21.300000 29.851562 77.15s
FLOAT_6_E3 89.570000 99.804688 48.220000 62.257812 21.390000 31.390625 77.14s
FLOAT_6_E4 87.980000 99.492188 45.690000 39.554688 22.790000 9.023438 77.11s
FLOAT_7_E1 86.840000 99.039062 41.350000 42.812500 19.330000 18.835938 120.79s
FLOAT_7_E2 88.630000 99.546875 44.440000 60.148438 21.050000 27.734375 120.65s
FLOAT_7_E3 89.950000 99.812500 48.060000 64.007812 19.780000 23.828125 120.79s
FLOAT_7_E4 89.280000 99.773438 48.030000 62.218750 21.390000 30.929688 120.54s
FLOAT_7_E5 87.790000 99.562500 45.490000 39.453125 22.620000 9.007812 120.39s
FLOAT_8_E1 86.990000 99.125000 42.250000 44.859375 19.130000 18.960938 203.77s
FLOAT_8_E2 88.850000 99.679688 44.820000 61.281250 20.120000 26.546875 203.59s
FLOAT_8_E3 90.120000 99.835938 48.090000 64.414062 19.210000 24.250000 203.75s
FLOAT_8_E4 89.810000 99.804688 48.030000 63.921875 19.600000 23.882812 203.55s
FLOAT_8_E5 89.560000 99.804688 48.230000 62.453125 21.530000 31.429688 203.70s
FLOAT_8_E6 87.870000 99.515625 45.530000 39.664062 22.880000 9.023438 204.57s
AlexNet_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.130000 98.140625 48.620000 53.664062 19.240000 21.531250 14.11s
INT_2 10.000000 9.859375 10.000000 9.859375 10.000000 9.859375 35.01s
INT_3 14.040000 14.937500 10.000000 9.859375 10.000000 9.859375 32.19s
INT_4 48.760000 50.593750 15.270000 15.078125 13.680000 11.140625 33.45s
INT_5 76.310000 89.203125 23.770000 24.539062 16.410000 15.882812 35.46s
INT_6 88.910000 97.398438 44.340000 59.687500 25.030000 34.093750 34.29s
INT_7 89.790000 98.390625 47.460000 57.789062 24.340000 28.945312 34.86s
INT_8 90.240000 98.226562 48.240000 55.875000 21.340000 24.593750 28.40s
INT_9 90.070000 98.210938 48.250000 54.171875 20.160000 22.367188 35.74s
INT_10 90.100000 98.148438 48.370000 53.789062 19.640000 22.046875 27.08s
INT_11 90.120000 98.140625 48.360000 53.882812 19.380000 21.640625 28.42s
INT_12 90.160000 98.156250 48.430000 53.468750 19.290000 21.445312 35.95s
INT_13 90.140000 98.164062 48.510000 53.726562 19.230000 21.523438 33.68s
INT_14 90.130000 98.156250 48.610000 53.640625 19.320000 21.492188 35.24s
INT_15 90.140000 98.156250 48.630000 53.695312 19.190000 21.484375 32.02s
INT_16 90.130000 98.148438 48.590000 53.648438 19.190000 21.468750 30.39s
POT_2 10.000000 9.859375 10.000000 9.859375 10.000000 9.859375 36.74s
POT_3 17.480000 18.789062 10.110000 11.898438 10.070000 9.265625 39.12s
POT_4 74.750000 82.226562 28.580000 19.375000 16.420000 4.570312 44.06s
POT_5 74.280000 82.382812 30.280000 20.734375 16.600000 3.804688 54.91s
POT_6 74.770000 81.304688 30.540000 19.132812 16.790000 3.882812 75.97s
POT_7 74.510000 81.250000 30.410000 19.304688 17.110000 4.023438 120.26s
POT_8 74.440000 81.210938 30.580000 19.148438 16.620000 4.062500 202.14s
FLOAT_3_E1 23.080000 30.210938 11.580000 12.078125 10.740000 10.859375 38.64s
FLOAT_4_E1 68.200000 79.320312 20.760000 27.664062 14.320000 22.875000 43.86s
FLOAT_4_E2 72.840000 62.210938 24.170000 24.750000 18.080000 20.062500 44.07s
FLOAT_5_E1 82.640000 93.945312 34.060000 25.593750 19.360000 8.656250 54.97s
FLOAT_5_E2 85.490000 93.062500 39.460000 45.640625 22.900000 32.156250 55.10s
FLOAT_5_E3 87.690000 97.679688 44.720000 52.140625 22.650000 33.414062 56.69s
FLOAT_6_E1 85.790000 97.007812 40.050000 23.304688 20.800000 2.242188 78.21s
FLOAT_6_E2 87.740000 96.273438 42.320000 46.750000 21.030000 23.171875 78.11s
FLOAT_6_E3 89.570000 98.117188 48.210000 54.781250 21.460000 33.867188 77.11s
FLOAT_6_E4 87.980000 97.796875 45.490000 51.765625 22.620000 33.242188 77.57s
FLOAT_7_E1 86.840000 97.500000 40.980000 23.367188 19.280000 2.437500 120.82s
FLOAT_7_E2 88.630000 97.476562 44.790000 49.515625 21.340000 21.687500 120.77s
FLOAT_7_E3 89.950000 98.000000 47.930000 54.250000 19.720000 23.625000 120.26s
FLOAT_7_E4 89.280000 98.210938 48.330000 54.109375 21.410000 33.726562 121.09s
FLOAT_7_E5 87.790000 97.656250 44.930000 50.390625 22.760000 32.015625 120.11s
FLOAT_8_E1 86.990000 97.312500 42.130000 24.601562 18.890000 2.265625 204.38s
FLOAT_8_E2 88.850000 97.835938 44.780000 50.250000 20.240000 21.273438 203.89s
FLOAT_8_E3 90.120000 97.992188 47.990000 53.593750 19.320000 21.429688 203.68s
FLOAT_8_E4 89.810000 97.984375 48.180000 54.085938 19.630000 23.789062 203.57s
FLOAT_8_E5 89.560000 98.187500 48.020000 54.031250 21.520000 33.882812 203.36s
FLOAT_8_E6 87.870000 97.664062 45.340000 51.070312 22.850000 32.656250 203.67s
AlexNet cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 88.640000 98.367188 45.350000 44.460938 19.840000 18.523438 12.74s
INT_2 10.000000 9.664062 10.000000 9.664062 10.000000 9.664062 25.70s
INT_3 10.120000 11.695312 10.000000 9.734375 10.000000 9.734375 26.12s
INT_4 55.630000 32.539062 14.140000 15.945312 11.180000 12.492188 26.08s
INT_5 82.870000 91.015625 38.720000 39.273438 29.440000 32.289062 27.52s
INT_6 87.290000 96.789062 43.940000 42.273438 30.270000 30.421875 26.53s
INT_7 88.210000 98.171875 44.080000 45.671875 25.950000 25.851562 27.96s
INT_8 88.450000 98.320312 45.320000 45.484375 23.240000 21.710938 26.62s
INT_9 88.620000 98.382812 45.110000 44.523438 21.210000 19.460938 28.96s
INT_10 88.700000 98.382812 45.330000 44.515625 20.510000 19.023438 27.46s
INT_11 88.660000 98.351562 45.370000 44.546875 20.060000 18.617188 28.68s
INT_12 88.650000 98.367188 45.280000 44.601562 19.970000 18.515625 28.58s
INT_13 88.610000 98.359375 45.300000 44.445312 19.930000 18.539062 28.37s
INT_14 88.630000 98.367188 45.280000 44.390625 19.850000 18.515625 28.09s
INT_15 88.620000 98.375000 45.340000 44.437500 19.920000 18.484375 27.94s
INT_16 88.640000 98.359375 45.360000 44.453125 19.860000 18.500000 29.81s
POT_2 10.000000 9.664062 10.000000 9.664062 10.000000 9.664062 38.80s
POT_3 16.660000 22.265625 10.000000 9.734375 10.000000 9.734375 39.44s
POT_4 69.820000 80.359375 28.350000 21.015625 17.140000 16.023438 44.81s
POT_5 69.760000 81.335938 27.910000 20.648438 15.550000 15.398438 54.06s
POT_6 70.700000 82.140625 27.860000 20.617188 15.480000 15.296875 75.89s
POT_7 70.330000 81.703125 27.980000 20.531250 15.410000 15.296875 118.40s
POT_8 69.780000 81.601562 27.390000 20.640625 15.190000 15.539062 202.54s
FLOAT_3_E1 23.290000 23.593750 14.870000 17.546875 12.380000 13.703125 38.63s
FLOAT_4_E1 68.090000 78.453125 23.870000 25.351562 17.530000 19.164062 45.01s
FLOAT_4_E2 66.380000 64.734375 24.690000 28.187500 20.490000 24.898438 44.96s
FLOAT_5_E1 79.440000 91.828125 28.910000 34.781250 18.920000 23.375000 54.94s
FLOAT_5_E2 84.040000 90.421875 38.090000 39.320312 23.950000 24.382812 54.86s
FLOAT_5_E3 85.010000 96.132812 39.170000 42.804688 19.610000 21.914062 54.40s
FLOAT_6_E1 83.300000 92.437500 33.340000 48.632812 18.750000 28.976562 76.28s
FLOAT_6_E2 87.160000 95.906250 40.520000 36.976562 21.800000 19.195312 76.35s
FLOAT_6_E3 88.000000 98.132812 44.240000 46.445312 20.020000 18.070312 75.01s
FLOAT_6_E4 85.260000 96.414062 39.190000 42.765625 19.890000 21.921875 76.13s
FLOAT_7_E1 85.010000 94.062500 35.230000 57.640625 17.780000 35.171875 118.51s
FLOAT_7_E2 87.530000 96.648438 41.790000 33.414062 20.990000 15.617188 119.42s
FLOAT_7_E3 88.620000 98.375000 44.910000 45.765625 19.990000 19.265625 118.86s
FLOAT_7_E4 88.100000 98.046875 44.130000 46.031250 19.990000 18.000000 118.58s
FLOAT_7_E5 85.250000 96.125000 39.210000 42.187500 19.480000 21.625000 119.04s
FLOAT_8_E1 86.050000 95.023438 36.430000 57.023438 17.670000 33.640625 202.68s
FLOAT_8_E2 87.840000 96.796875 42.310000 31.882812 19.590000 14.875000 202.56s
FLOAT_8_E3 88.720000 98.507812 44.790000 45.359375 19.850000 18.406250 203.11s
FLOAT_8_E4 88.620000 98.343750 44.770000 45.515625 20.090000 19.156250 203.37s
FLOAT_8_E5 88.150000 98.187500 44.180000 45.843750 20.120000 18.125000 203.58s
FLOAT_8_E6 85.170000 96.140625 38.670000 42.554688 19.550000 21.828125 203.49s
Inception_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.830000 99.976562 42.840000 61.320312 7.240000 4.601562 158.12s
INT_2 10.000000 10.039062 10.000000 10.039062 10.000000 10.039062 289.91s
INT_3 10.680000 11.445312 10.090000 9.281250 10.320000 9.921875 286.58s
INT_4 29.840000 34.031250 13.340000 25.953125 11.530000 23.289062 309.70s
INT_5 80.350000 87.601562 31.260000 43.593750 16.150000 26.859375 310.38s
INT_6 93.480000 99.765625 41.320000 58.539062 12.690000 23.078125 314.44s
INT_7 94.540000 99.976562 42.930000 61.117188 9.610000 11.625000 313.02s
INT_8 94.830000 99.976562 43.680000 61.593750 8.100000 6.328125 311.08s
INT_9 94.840000 99.960938 43.210000 60.367188 7.430000 4.828125 309.57s
INT_10 94.790000 99.968750 42.950000 60.304688 7.220000 4.656250 305.39s
INT_11 94.840000 99.968750 42.830000 60.445312 7.210000 4.523438 308.33s
INT_12 94.850000 99.968750 42.900000 60.382812 7.230000 4.507812 313.92s
INT_13 94.820000 99.968750 42.740000 60.468750 7.250000 4.515625 292.75s
INT_14 94.830000 99.968750 42.790000 60.414062 7.060000 4.531250 309.78s
INT_15 94.810000 99.968750 42.850000 60.398438 7.250000 4.523438 309.29s
INT_16 94.830000 99.968750 42.800000 60.445312 7.200000 4.492188 307.34s
POT_2 10.000000 10.039062 10.000000 10.039062 10.000000 10.039062 449.54s
POT_3 11.500000 8.343750 9.780000 9.632812 9.630000 9.210938 502.14s
POT_4 38.810000 24.929688 14.590000 15.445312 10.510000 13.671875 639.36s
POT_5 40.190000 39.179688 16.720000 26.164062 13.180000 21.125000 909.17s
POT_6 23.960000 24.367188 13.880000 16.445312 9.070000 13.445312 1425.79s
POT_7 38.480000 48.031250 18.230000 26.125000 10.690000 18.312500 2487.01s
POT_8 40.730000 42.921875 19.370000 23.312500 12.090000 14.000000 4562.34s
FLOAT_3_E1 10.000000 9.890625 9.910000 9.218750 10.140000 9.398438 503.88s
FLOAT_4_E1 19.150000 30.679688 20.670000 15.750000 14.380000 12.265625 640.31s
FLOAT_4_E2 54.380000 44.984375 16.450000 25.640625 10.530000 16.679688 640.48s
FLOAT_5_E1 60.290000 76.406250 28.360000 38.593750 15.290000 22.578125 906.06s
FLOAT_5_E2 85.500000 98.218750 37.320000 39.484375 17.170000 17.351562 906.78s
FLOAT_5_E3 86.480000 99.593750 40.220000 59.359375 13.480000 26.515625 907.52s
FLOAT_6_E1 76.320000 95.289062 30.400000 43.734375 12.730000 19.054688 1420.68s
FLOAT_6_E2 92.260000 99.859375 40.440000 46.671875 14.370000 13.015625 1424.48s
FLOAT_6_E3 93.400000 99.929688 43.200000 62.179688 11.020000 16.570312 1426.48s
FLOAT_6_E4 86.480000 99.500000 38.810000 51.578125 14.470000 22.687500 1422.52s
FLOAT_7_E1 78.170000 97.359375 31.890000 42.812500 11.760000 14.968750 2480.58s
FLOAT_7_E2 93.010000 99.914062 42.120000 46.851562 13.230000 9.828125 2480.65s
FLOAT_7_E3 94.470000 99.976562 43.230000 57.070312 8.860000 6.117188 2485.42s
FLOAT_7_E4 93.430000 99.953125 42.890000 63.476562 11.410000 17.773438 2486.79s
FLOAT_7_E5 87.980000 98.765625 38.120000 51.718750 14.820000 25.601562 2484.98s
Inception_BN cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.830000 88.007812 42.810000 46.429688 7.230000 5.210938 157.45s
INT_2 10.000000 9.539062 10.000000 9.539062 10.000000 9.539062 312.83s
INT_3 10.750000 7.906250 9.430000 10.664062 9.670000 9.742188 273.20s
INT_4 29.690000 28.929688 14.540000 19.476562 10.040000 15.421875 327.39s
INT_5 80.670000 59.156250 30.230000 29.742188 16.490000 18.468750 326.41s
INT_6 93.540000 79.750000 42.680000 40.429688 13.360000 15.554688 313.06s
INT_7 94.510000 86.109375 42.520000 45.703125 9.560000 10.015625 321.22s
INT_8 94.860000 86.617188 43.170000 45.945312 8.010000 5.648438 317.96s
INT_9 94.810000 85.437500 43.200000 45.750000 7.580000 5.710938 326.22s
INT_10 94.840000 85.554688 42.920000 45.273438 7.240000 5.296875 308.54s
INT_11 94.840000 85.335938 42.870000 45.500000 7.360000 5.328125 308.32s
INT_12 94.850000 85.539062 42.750000 45.359375 7.230000 5.234375 319.09s
INT_13 94.820000 85.296875 42.870000 45.484375 7.120000 5.171875 313.66s
INT_14 94.840000 85.359375 42.820000 45.460938 7.210000 5.164062 308.37s
INT_15 94.810000 85.585938 42.770000 45.515625 7.200000 5.226562 309.83s
INT_16 94.830000 85.632812 42.780000 45.523438 7.270000 5.210938 312.72s
POT_2 10.000000 9.539062 10.000000 9.539062 10.000000 9.539062 442.95s
POT_3 11.540000 10.664062 10.350000 9.187500 10.290000 9.710938 500.26s
POT_4 38.340000 21.226562 26.370000 22.453125 16.150000 11.648438 639.03s
POT_5 39.980000 34.382812 17.060000 16.164062 11.520000 11.773438 908.58s
POT_6 24.030000 15.484375 13.480000 11.171875 9.170000 10.406250 1426.20s
POT_7 38.250000 40.664062 22.170000 20.437500 15.010000 9.546875 2483.35s
POT_8 41.360000 32.523438 23.510000 20.164062 14.980000 12.617188 4567.44s
FLOAT_3_E1 10.030000 9.968750 9.950000 9.984375 10.060000 10.132812 503.42s
FLOAT_4_E1 17.620000 28.054688 19.260000 16.750000 14.870000 11.382812 639.87s
FLOAT_4_E2 54.990000 26.539062 16.470000 19.804688 10.100000 9.843750 640.43s
FLOAT_5_E1 59.920000 48.804688 28.060000 29.125000 14.400000 19.906250 905.43s
FLOAT_5_E2 85.410000 71.265625 33.910000 26.796875 16.600000 12.984375 910.60s
FLOAT_5_E3 86.580000 72.437500 37.810000 41.031250 13.790000 18.593750 903.49s
FLOAT_6_E1 76.300000 58.875000 30.310000 32.015625 12.410000 15.710938 1420.05s
FLOAT_6_E2 92.190000 88.070312 41.010000 36.132812 14.840000 9.726562 1419.32s
FLOAT_6_E3 93.290000 86.539062 42.810000 42.671875 11.900000 12.796875 1422.39s
FLOAT_6_E4 86.740000 78.867188 39.560000 44.601562 14.680000 18.531250 1421.04s
FLOAT_7_E1 78.370000 58.156250 30.890000 33.570312 11.620000 14.000000 2480.21s
FLOAT_7_E2 93.030000 88.695312 42.090000 39.156250 13.060000 9.492188 2483.90s
FLOAT_7_E3 94.450000 88.250000 43.370000 43.000000 9.310000 6.257812 2482.01s
FLOAT_7_E4 93.570000 85.632812 43.480000 43.718750 11.540000 13.203125 2481.06s
FLOAT_7_E5 88.000000 68.929688 39.650000 41.398438 14.730000 17.562500 2482.61s
FLOAT_8_E1 82.240000 61.664062 31.650000 31.703125 10.610000 12.351562 4562.81s
FLOAT_8_E2 93.680000 86.945312 41.010000 35.921875 12.320000 8.031250 4563.76s
FLOAT_8_E3 94.760000 86.843750 42.640000 45.796875 7.780000 5.781250 4562.76s
FLOAT_8_E4 94.460000 88.773438 43.660000 41.367188 9.330000 5.921875 4575.23s
FLOAT_8_E5 93.290000 86.468750 41.740000 41.054688 11.830000 11.843750 4576.43s
FLOAT_8_E6 87.980000 77.648438 37.900000 42.898438 14.720000 18.507812 4572.51s
MobileNetV2 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.270000 99.960938 40.190000 76.007812 5.550000 16.015625 58.61s
INT_2 10.000000 9.453125 10.000000 9.453125 10.000000 9.453125 228.33s
INT_3 9.960000 9.453125 10.000000 9.453125 10.000000 9.453125 225.76s
INT_4 9.490000 10.398438 10.280000 9.835938 10.150000 9.960938 229.86s
INT_5 20.560000 38.156250 11.720000 18.320312 10.230000 14.906250 229.48s
INT_6 57.910000 94.695312 24.450000 39.335938 14.740000 25.492188 229.98s
INT_7 80.300000 99.617188 35.160000 64.382812 12.750000 33.750000 228.65s
INT_8 88.180000 99.898438 43.090000 76.250000 10.770000 28.632812 228.98s
INT_9 89.760000 99.937500 41.570000 74.953125 8.410000 21.726562 227.42s
INT_10 90.380000 99.968750 40.400000 75.234375 6.480000 18.093750 204.56s
INT_11 90.290000 99.945312 40.410000 76.359375 5.950000 17.062500 230.18s
INT_12 90.270000 99.960938 40.260000 75.882812 5.750000 16.234375 228.24s
INT_13 90.240000 99.960938 40.270000 76.000000 5.760000 16.195312 184.42s
INT_14 90.260000 99.960938 40.140000 75.937500 5.610000 16.101562 231.10s
INT_15 90.270000 99.960938 40.220000 76.000000 5.660000 16.085938 230.59s
INT_16 90.270000 99.960938 40.100000 76.117188 5.650000 16.085938 226.82s
POT_2 10.000000 9.453125 10.000000 9.453125 10.000000 9.453125 249.26s
POT_3 9.990000 9.343750 9.790000 9.484375 9.910000 9.453125 253.89s
POT_4 14.620000 21.656250 10.240000 14.851562 10.260000 14.046875 267.65s
POT_5 14.390000 20.992188 10.700000 12.523438 10.550000 9.789062 314.54s
POT_6 14.330000 20.406250 10.030000 11.757812 10.020000 11.039062 446.22s
POT_7 15.040000 22.085938 10.510000 15.671875 10.100000 12.734375 688.91s
POT_8 14.710000 20.492188 11.000000 12.359375 10.430000 11.156250 1190.58s
FLOAT_3_E1 9.660000 9.859375 9.960000 10.007812 9.920000 10.117188 222.21s
FLOAT_4_E1 11.660000 13.765625 10.170000 10.539062 11.100000 10.703125 269.14s
FLOAT_4_E2 13.230000 19.789062 10.430000 13.820312 10.080000 13.921875 269.10s
FLOAT_5_E1 17.160000 32.843750 11.100000 21.820312 10.590000 19.171875 320.41s
FLOAT_5_E2 26.760000 49.726562 14.300000 24.031250 11.460000 21.664062 316.64s
FLOAT_5_E3 46.320000 76.359375 28.230000 38.593750 15.810000 27.125000 325.47s
FLOAT_6_E1 28.010000 48.945312 11.350000 28.734375 10.320000 25.109375 445.64s
FLOAT_6_E2 45.820000 88.882812 21.670000 25.640625 13.820000 20.078125 445.42s
FLOAT_6_E3 69.910000 97.281250 37.480000 64.585938 13.410000 35.734375 444.29s
FLOAT_6_E4 46.590000 77.820312 27.800000 37.906250 15.840000 25.828125 444.06s
FLOAT_7_E1 33.850000 65.789062 12.760000 12.945312 9.460000 10.710938 695.39s
FLOAT_7_E2 59.400000 95.421875 21.080000 24.164062 9.980000 16.007812 675.21s
FLOAT_7_E3 85.620000 99.906250 38.860000 71.718750 11.040000 29.531250 682.41s
FLOAT_7_E4 68.900000 97.562500 36.920000 63.671875 13.480000 34.007812 676.20s
FLOAT_7_E5 47.350000 76.328125 23.630000 37.179688 13.530000 25.382812 689.76s
FLOAT_8_E1 41.420000 72.015625 11.360000 22.734375 10.010000 15.734375 1184.54s
FLOAT_8_E2 68.860000 97.851562 24.470000 32.976562 11.570000 21.460938 1189.14s
FLOAT_8_E3 89.220000 99.960938 40.040000 71.375000 8.530000 22.945312 1193.14s
FLOAT_8_E4 85.830000 99.867188 37.180000 68.492188 10.300000 27.601562 1187.11s
FLOAT_8_E5 68.490000 97.140625 36.850000 63.984375 13.690000 35.257812 1192.24s
FLOAT_8_E6 46.620000 76.835938 27.690000 38.179688 15.320000 25.703125 1191.62s
MobileNetV2 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 90.270000 75.890625 40.190000 36.140625 5.590000 3.234375 57.71s
INT_2 10.000000 9.960938 10.000000 9.960938 10.000000 9.960938 140.67s
INT_3 9.960000 9.960938 10.000000 9.960938 10.000000 9.960938 203.35s
INT_4 9.490000 8.921875 10.470000 9.171875 10.220000 9.117188 221.97s
INT_5 20.560000 21.453125 12.930000 13.609375 10.540000 13.062500 219.63s
INT_6 57.910000 59.773438 23.630000 22.429688 14.120000 12.093750 223.85s
INT_7 80.300000 70.710938 36.340000 31.156250 13.340000 12.796875 223.15s
INT_8 88.180000 72.945312 42.470000 36.648438 10.800000 7.296875 222.42s
INT_9 89.760000 76.039062 41.690000 35.085938 8.180000 4.953125 224.29s
INT_10 90.380000 76.070312 40.280000 35.804688 6.340000 3.812500 220.84s
INT_11 90.290000 75.656250 40.460000 36.070312 5.930000 3.484375 225.77s
INT_12 90.270000 75.679688 40.280000 36.039062 5.750000 3.281250 221.15s
INT_13 90.240000 75.804688 40.230000 36.039062 5.770000 3.203125 221.53s
INT_14 90.260000 75.851562 40.170000 36.195312 5.660000 3.187500 222.13s
INT_15 90.270000 75.882812 40.190000 36.039062 5.630000 3.218750 223.85s
INT_16 90.270000 75.875000 40.150000 36.078125 5.580000 3.203125 222.96s
POT_2 10.000000 9.960938 10.000000 9.960938 10.000000 9.960938 243.47s
POT_3 9.990000 9.882812 9.670000 9.281250 9.610000 9.593750 240.64s
POT_4 14.620000 12.492188 10.170000 16.406250 10.070000 15.171875 262.08s
POT_5 14.390000 11.203125 10.610000 12.218750 10.590000 10.539062 317.48s
POT_6 14.330000 12.171875 10.020000 12.226562 10.000000 10.890625 436.84s
POT_7 15.040000 14.234375 10.490000 16.687500 10.250000 14.820312 690.31s
POT_8 14.710000 12.039062 11.290000 12.656250 10.560000 11.804688 1186.04s
FLOAT_3_E1 9.660000 9.750000 10.420000 9.703125 10.340000 9.921875 238.90s
FLOAT_4_E1 11.660000 11.148438 11.340000 9.953125 10.950000 8.992188 261.89s
FLOAT_4_E2 13.230000 15.601562 11.040000 12.132812 10.780000 11.171875 264.80s
FLOAT_5_E1 17.160000 14.484375 10.780000 13.296875 10.350000 12.828125 319.40s
FLOAT_5_E2 26.760000 25.257812 14.530000 20.609375 11.370000 17.187500 322.91s
FLOAT_5_E3 46.320000 35.921875 26.910000 18.406250 14.750000 11.726562 323.57s
FLOAT_6_E1 28.010000 21.164062 11.670000 13.085938 10.670000 10.898438 441.74s
FLOAT_6_E2 45.820000 50.187500 21.360000 21.625000 13.380000 15.359375 441.60s
FLOAT_6_E3 69.910000 66.226562 37.160000 31.343750 13.500000 10.710938 419.23s
FLOAT_6_E4 46.590000 35.015625 27.670000 18.195312 15.450000 10.656250 438.30s
FLOAT_7_E1 33.850000 42.398438 12.750000 13.359375 9.600000 8.742188 672.35s
FLOAT_7_E2 59.400000 57.781250 21.050000 16.929688 10.500000 10.140625 679.77s
FLOAT_7_E3 85.620000 75.304688 39.370000 37.000000 10.910000 9.648438 679.33s
FLOAT_7_E4 68.900000 65.718750 36.710000 30.421875 13.590000 10.265625 690.20s
FLOAT_7_E5 47.350000 38.382812 24.230000 21.367188 13.760000 16.851562 668.22s
FLOAT_8_E1 41.420000 42.039062 11.290000 18.187500 9.980000 11.757812 1183.25s
FLOAT_8_E2 68.860000 58.406250 25.150000 18.640625 11.960000 9.539062 1182.87s
FLOAT_8_E3 89.220000 75.000000 39.870000 33.851562 8.730000 6.867188 1185.24s
FLOAT_8_E4 85.830000 75.945312 37.480000 36.562500 10.440000 8.906250 1187.76s
FLOAT_8_E5 68.490000 65.054688 36.680000 30.789062 13.730000 10.367188 1180.14s
FLOAT_8_E6 46.620000 36.007812 27.130000 17.242188 15.720000 10.234375 1187.43s
ResNet_152 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.430000 82.945312 44.280000 40.617188 10.150000 11.281250 327.10s
INT_2 10.000000 10.179688 10.000000 10.179688 10.000000 10.179688 837.44s
INT_3 10.030000 15.242188 9.990000 10.992188 9.990000 10.914062 842.54s
INT_4 15.610000 15.093750 8.960000 11.781250 9.210000 11.539062 845.09s
INT_5 30.350000 11.750000 17.610000 10.328125 13.970000 10.304688 850.06s
INT_6 74.440000 24.976562 17.420000 52.289062 7.250000 24.015625 847.64s
INT_7 90.430000 58.632812 35.830000 51.773438 10.340000 14.453125 842.06s
INT_8 94.060000 80.796875 41.780000 38.859375 11.150000 11.289062 839.31s
INT_9 94.280000 82.921875 45.410000 39.656250 11.100000 11.148438 846.84s
INT_10 94.450000 83.195312 43.900000 40.585938 10.420000 11.867188 837.70s
INT_11 94.390000 83.273438 44.180000 40.460938 10.280000 11.273438 843.87s
INT_12 94.410000 83.070312 44.240000 40.648438 10.150000 11.406250 839.62s
INT_13 94.440000 82.968750 44.300000 40.492188 10.140000 11.210938 843.67s
INT_14 94.430000 82.875000 44.460000 40.781250 10.240000 11.265625 838.38s
INT_15 94.420000 82.914062 44.310000 40.679688 10.220000 11.312500 840.17s
INT_16 94.430000 82.906250 44.390000 40.632812 10.180000 11.281250 839.31s
POT_2 10.000000 10.179688 10.000000 10.179688 10.000000 10.179688 1220.44s
POT_3 10.010000 12.671875 10.390000 14.234375 10.420000 14.554688 1389.87s
POT_4 43.550000 32.453125 17.810000 21.554688 11.080000 16.914062 1775.54s
POT_5 43.000000 24.554688 17.400000 28.750000 11.100000 17.304688 2581.30s
POT_6 40.110000 34.664062 18.850000 22.343750 12.360000 17.015625 4165.48s
POT_7 34.390000 28.687500 19.560000 18.109375 13.220000 14.476562 7427.86s
POT_8 39.190000 39.695312 18.710000 18.664062 13.120000 16.187500 13804.55s
FLOAT_3_E1 9.970000 15.734375 10.000000 9.968750 10.000000 9.968750 1384.86s
FLOAT_4_E1 18.600000 10.773438 11.530000 9.539062 9.750000 8.382812 1780.54s
FLOAT_4_E2 19.530000 23.335938 12.460000 18.726562 10.830000 17.187500 1778.50s
FLOAT_5_E1 61.040000 23.507812 16.320000 25.726562 9.940000 11.859375 2579.43s
FLOAT_5_E2 73.510000 36.351562 26.920000 42.765625 14.370000 24.898438 2585.40s
FLOAT_5_E3 84.050000 45.218750 28.630000 41.265625 13.650000 26.765625 2581.44s
FLOAT_6_E1 87.580000 69.328125 36.360000 41.992188 14.300000 7.453125 4150.79s
FLOAT_6_E2 82.830000 49.992188 27.760000 35.648438 14.260000 22.250000 4152.38s
FLOAT_6_E3 91.170000 57.562500 37.240000 44.117188 12.300000 8.039062 4164.32s
FLOAT_6_E4 85.330000 46.023438 30.710000 40.304688 13.220000 26.726562 4160.66s
FLOAT_7_E1 90.300000 83.601562 35.850000 26.359375 15.280000 8.570312 7388.60s
FLOAT_7_E2 85.720000 48.398438 27.820000 32.976562 12.420000 19.898438 7393.53s
FLOAT_7_E3 93.620000 74.273438 43.020000 44.156250 12.260000 13.476562 7409.19s
FLOAT_7_E4 91.100000 59.023438 36.440000 43.937500 11.750000 8.085938 7428.80s
ResNet_18 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.300000 99.984375 47.320000 82.757812 11.300000 60.851562 61.58s
INT_2 10.000000 9.882812 10.000000 9.882812 10.000000 9.882812 113.99s
INT_3 10.000000 9.625000 10.000000 9.625000 10.000000 9.625000 110.67s
INT_4 49.440000 55.828125 21.800000 34.109375 14.300000 27.742188 115.23s
INT_5 87.620000 98.531250 34.660000 52.773438 20.740000 42.156250 117.49s
INT_6 93.250000 99.945312 47.120000 82.835938 16.640000 66.960938 111.18s
INT_7 94.070000 99.953125 46.560000 81.468750 13.600000 62.968750 110.95s
INT_8 94.260000 99.976562 48.200000 83.757812 12.300000 62.914062 112.09s
INT_9 94.350000 99.976562 47.650000 83.375000 11.700000 62.328125 110.99s
INT_10 94.340000 99.976562 47.670000 82.531250 11.450000 61.117188 108.41s
INT_11 94.290000 99.976562 47.590000 82.851562 11.420000 61.273438 112.16s
INT_12 94.320000 99.984375 47.530000 82.875000 11.280000 61.054688 113.02s
INT_13 94.310000 99.984375 47.490000 82.789062 11.360000 61.078125 113.65s
INT_14 94.320000 99.976562 47.390000 82.820312 11.390000 61.085938 114.14s
INT_15 94.300000 99.976562 47.420000 82.796875 11.330000 61.125000 116.35s
INT_16 94.320000 99.976562 47.340000 82.750000 11.310000 61.164062 112.37s
POT_2 10.000000 9.882812 10.000000 9.882812 10.000000 9.882812 172.08s
POT_3 10.200000 14.468750 10.050000 13.390625 8.030000 11.812500 192.24s
POT_4 63.780000 75.414062 28.790000 18.781250 17.630000 14.562500 233.05s
POT_5 50.530000 51.570312 24.380000 10.195312 13.340000 9.984375 314.09s
POT_6 51.610000 57.195312 24.930000 10.351562 14.880000 10.078125 475.13s
POT_7 49.050000 53.460938 26.370000 11.148438 15.120000 10.148438 805.59s
POT_8 55.540000 59.414062 26.630000 10.859375 16.300000 10.265625 1438.61s
FLOAT_3_E1 12.740000 15.453125 11.000000 13.179688 11.810000 12.515625 190.74s
FLOAT_4_E1 47.470000 59.093750 22.790000 14.085938 17.650000 12.562500 232.41s
FLOAT_4_E2 52.510000 95.570312 17.470000 27.437500 10.200000 20.601562 233.23s
FLOAT_5_E1 81.840000 91.625000 36.050000 32.656250 18.880000 23.625000 315.02s
FLOAT_5_E2 85.740000 99.890625 35.820000 58.484375 14.070000 37.796875 315.16s
FLOAT_5_E3 89.480000 99.851562 44.030000 75.523438 17.910000 59.203125 315.12s
FLOAT_6_E1 87.390000 98.367188 40.690000 32.328125 16.650000 19.828125 476.72s
FLOAT_6_E2 91.650000 99.914062 42.820000 77.484375 13.280000 56.468750 476.46s
FLOAT_6_E3 93.410000 99.984375 46.900000 83.117188 14.290000 64.664062 476.15s
FLOAT_6_E4 89.530000 99.828125 44.860000 73.500000 18.060000 56.882812 476.13s
FLOAT_7_E1 90.160000 98.796875 42.160000 52.984375 15.160000 36.179688 807.53s
FLOAT_7_E2 92.610000 99.945312 45.390000 80.851562 12.460000 60.054688 807.65s
FLOAT_7_E3 94.080000 99.984375 48.150000 83.132812 13.180000 62.726562 807.36s
FLOAT_7_E4 93.120000 99.929688 47.440000 81.375000 15.060000 61.218750 807.40s
FLOAT_7_E5 89.320000 99.734375 41.960000 62.453125 18.720000 44.476562 807.31s
FLOAT_8_E1 90.340000 99.343750 41.100000 49.804688 14.850000 32.750000 1439.81s
FLOAT_8_E2 92.250000 99.953125 43.710000 72.687500 13.540000 49.375000 1439.54s
FLOAT_8_E3 94.240000 99.976562 47.240000 82.289062 11.960000 61.062500 1439.69s
FLOAT_8_E4 94.060000 99.976562 47.570000 82.531250 12.870000 62.132812 1439.74s
FLOAT_8_E5 93.310000 99.968750 46.900000 84.390625 14.510000 65.539062 1439.76s
FLOAT_8_E6 89.410000 99.781250 43.070000 67.773438 18.690000 50.945312 1440.24s
ResNet_18 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.300000 99.414062 47.310000 47.835938 11.270000 10.867188 59.05s
INT_2 10.000000 9.843750 10.000000 9.843750 10.000000 9.843750 105.14s
INT_3 10.000000 10.007812 10.000000 10.007812 10.000000 10.007812 105.30s
INT_4 49.440000 28.398438 20.680000 24.406250 14.080000 17.132812 105.48s
INT_5 87.620000 87.671875 34.230000 39.539062 19.800000 19.164062 105.49s
INT_6 93.250000 98.453125 47.820000 52.632812 16.790000 18.226562 105.88s
INT_7 94.070000 98.898438 46.700000 47.726562 13.450000 13.914062 128.22s
INT_8 94.260000 99.398438 48.870000 48.085938 12.440000 12.304688 109.68s
INT_9 94.350000 99.437500 47.720000 49.085938 11.800000 11.414062 126.65s
INT_10 94.340000 99.406250 47.400000 47.968750 11.470000 11.085938 130.41s
INT_11 94.290000 99.414062 47.590000 48.164062 11.430000 11.085938 124.30s
INT_12 94.320000 99.421875 47.470000 48.023438 11.370000 10.812500 105.42s
INT_13 94.310000 99.414062 47.440000 48.015625 11.390000 10.882812 118.16s
INT_14 94.320000 99.414062 47.420000 48.093750 11.190000 10.921875 119.38s
INT_15 94.300000 99.414062 47.470000 48.031250 11.450000 10.921875 126.28s
INT_16 94.320000 99.414062 47.480000 48.093750 11.290000 10.953125 126.69s
POT_2 10.000000 9.843750 10.000000 9.843750 10.000000 9.843750 169.25s
POT_3 10.200000 14.890625 10.350000 10.046875 8.400000 7.742188 190.90s
POT_4 63.780000 61.000000 29.720000 10.218750 17.810000 5.429688 231.81s
POT_5 50.530000 68.671875 26.900000 10.445312 15.230000 4.335938 311.95s
POT_6 51.610000 72.226562 27.290000 10.101562 15.910000 9.226562 472.97s
POT_7 49.050000 71.421875 28.030000 10.531250 15.920000 5.140625 802.77s
POT_8 55.540000 71.281250 28.080000 10.250000 16.380000 8.296875 1439.04s
FLOAT_3_E1 12.740000 23.578125 11.370000 13.601562 11.430000 13.273438 189.11s
FLOAT_4_E1 47.470000 51.546875 24.570000 13.429688 17.960000 10.171875 228.67s
FLOAT_4_E2 52.510000 82.953125 16.440000 11.648438 9.930000 10.578125 229.72s
FLOAT_5_E1 81.840000 71.031250 37.930000 11.773438 20.110000 5.796875 311.31s
FLOAT_5_E2 85.740000 97.453125 36.790000 35.609375 12.920000 13.664062 313.17s
FLOAT_5_E3 89.480000 95.187500 43.070000 32.476562 17.940000 19.031250 312.07s
FLOAT_6_E1 87.390000 89.695312 41.370000 11.984375 16.970000 1.296875 473.94s
FLOAT_6_E2 91.650000 99.054688 42.760000 38.984375 13.620000 13.421875 473.40s
FLOAT_6_E3 93.410000 99.046875 46.530000 33.992188 14.550000 11.796875 473.30s
FLOAT_6_E4 89.530000 95.625000 44.260000 35.390625 17.820000 20.460938 472.14s
FLOAT_7_E1 90.160000 93.593750 41.590000 15.351562 15.700000 0.828125 801.96s
FLOAT_7_E2 92.610000 99.070312 44.680000 43.726562 12.340000 14.000000 802.51s
FLOAT_7_E3 94.080000 99.437500 48.210000 45.812500 13.040000 12.179688 801.48s
FLOAT_7_E4 93.120000 99.109375 47.720000 40.773438 14.930000 12.601562 801.43s
FLOAT_7_E5 89.320000 95.203125 42.210000 39.250000 17.570000 22.953125 801.24s
FLOAT_8_E1 90.340000 94.007812 41.470000 16.093750 14.760000 0.554688 1437.55s
FLOAT_8_E2 92.250000 99.171875 43.930000 30.164062 13.510000 12.054688 1439.68s
FLOAT_8_E3 94.240000 99.398438 47.440000 45.812500 12.370000 12.070312 1438.96s
FLOAT_8_E4 94.060000 99.382812 47.390000 45.953125 13.020000 12.484375 1438.85s
FLOAT_8_E5 93.310000 99.031250 46.520000 40.296875 14.590000 12.234375 1438.88s
FLOAT_8_E6 89.410000 91.976562 42.590000 26.476562 19.140000 15.687500 1439.03s
ResNet_50 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.570000 99.945312 44.350000 70.015625 8.940000 13.328125 132.07s
INT_2 10.000000 9.820312 10.000000 9.820312 10.000000 9.820312 325.77s
INT_3 10.040000 14.148438 10.080000 12.039062 10.040000 12.109375 323.77s
INT_4 24.550000 21.554688 11.880000 9.898438 10.870000 9.882812 274.27s
INT_5 79.260000 83.382812 36.870000 39.500000 21.580000 22.937500 311.02s
INT_6 92.880000 99.015625 45.070000 55.203125 15.340000 19.492188 309.83s
INT_7 93.760000 99.921875 44.650000 64.335938 12.250000 14.515625 307.40s
INT_8 94.400000 99.921875 45.510000 71.429688 11.380000 16.343750 307.96s
INT_9 94.510000 99.945312 45.000000 70.609375 9.550000 14.187500 324.85s
INT_10 94.550000 99.945312 44.320000 69.859375 9.180000 13.507812 309.98s
INT_11 94.660000 99.945312 44.560000 70.039062 8.940000 13.304688 308.57s
INT_12 94.580000 99.945312 44.520000 69.953125 8.980000 13.421875 309.40s
INT_13 94.580000 99.945312 44.470000 69.945312 8.950000 13.195312 309.02s
INT_14 94.570000 99.945312 44.470000 69.929688 9.020000 13.171875 308.25s
INT_15 94.570000 99.945312 44.370000 70.031250 8.950000 13.242188 307.84s
INT_16 94.570000 99.945312 44.380000 69.937500 9.030000 13.304688 308.10s
POT_2 10.000000 9.820312 10.000000 9.820312 10.000000 9.820312 485.49s
POT_3 10.390000 12.835938 10.030000 9.585938 9.930000 9.476562 567.34s
POT_4 51.590000 74.953125 19.470000 30.929688 13.380000 19.828125 756.15s
POT_5 50.500000 73.953125 17.320000 36.148438 11.770000 31.187500 1123.11s
POT_6 55.340000 72.921875 22.490000 39.312500 14.490000 32.406250 1847.88s
POT_7 50.930000 72.921875 20.260000 36.695312 13.530000 28.648438 3331.46s
POT_8 44.430000 75.757812 18.900000 32.453125 14.180000 28.312500 6251.90s
FLOAT_3_E1 9.440000 15.210938 9.810000 3.289062 9.880000 2.976562 567.61s
FLOAT_4_E1 53.580000 32.593750 15.650000 21.671875 13.770000 18.554688 757.48s
FLOAT_4_E2 19.850000 58.656250 9.520000 37.015625 7.560000 35.359375 755.65s
ResNet_50 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 94.570000 95.296875 44.360000 45.945312 8.980000 10.601562 135.24s
INT_2 10.000000 10.328125 10.000000 10.328125 10.000000 10.328125 313.70s
INT_3 10.040000 13.429688 10.050000 13.992188 10.070000 14.164062 318.85s
INT_4 24.480000 18.546875 10.970000 10.367188 10.650000 10.625000 316.06s
INT_5 79.260000 59.109375 37.500000 27.835938 19.430000 16.328125 296.41s
INT_6 92.840000 90.531250 46.820000 40.570312 15.700000 13.406250 323.31s
INT_7 93.730000 93.828125 43.610000 42.125000 11.800000 10.304688 305.24s
INT_8 94.450000 95.585938 45.520000 48.046875 10.950000 12.203125 303.49s
INT_9 94.550000 94.570312 44.480000 45.390625 9.540000 11.250000 303.94s
INT_10 94.580000 94.906250 44.460000 45.843750 9.100000 10.898438 305.67s
INT_11 94.640000 95.296875 44.510000 45.945312 9.030000 10.500000 308.67s
INT_12 94.580000 95.257812 44.410000 46.054688 8.940000 10.671875 303.62s
INT_13 94.590000 95.273438 44.450000 45.921875 8.950000 10.679688 305.91s
INT_14 94.600000 95.273438 44.470000 45.945312 8.960000 10.695312 272.73s
INT_15 94.570000 95.281250 44.520000 45.835938 8.930000 10.625000 289.87s
INT_16 94.570000 95.296875 44.380000 45.890625 8.950000 10.617188 272.32s
POT_2 10.000000 10.328125 10.000000 10.328125 10.000000 10.328125 485.14s
POT_3 10.260000 12.617188 10.000000 9.578125 10.000000 9.437500 564.90s
POT_4 51.730000 72.195312 19.410000 30.421875 13.800000 24.734375 757.13s
POT_5 53.030000 64.093750 21.140000 26.039062 14.780000 22.023438 1128.74s
POT_6 55.280000 66.914062 21.140000 33.882812 13.710000 28.804688 1857.15s
POT_7 51.220000 68.859375 18.990000 30.648438 12.140000 23.312500 3337.61s
POT_8 44.780000 58.265625 18.930000 25.929688 13.450000 21.671875 6253.15s
FLOAT_3_E1 9.440000 15.976562 9.010000 8.359375 8.890000 8.507812 567.10s
FLOAT_4_E1 52.520000 40.414062 16.870000 24.734375 12.980000 15.328125 757.10s
FLOAT_4_E2 19.800000 33.039062 10.030000 31.843750 8.310000 28.679688 755.31s
FLOAT_5_E1 84.380000 77.562500 40.060000 40.164062 21.950000 29.828125 1122.66s
FLOAT_5_E2 63.310000 59.867188 21.590000 31.250000 13.280000 24.078125 1127.25s
FLOAT_5_E3 88.820000 85.156250 42.390000 45.140625 20.040000 27.195312 1128.58s
FLOAT_6_E1 87.410000 84.593750 38.790000 45.656250 17.710000 28.890625 1851.13s
FLOAT_6_E2 88.610000 77.281250 35.700000 45.382812 15.570000 31.609375 1853.98s
FLOAT_6_E3 92.990000 90.609375 44.470000 49.640625 14.770000 17.515625 1857.08s
FLOAT_6_E4 88.470000 83.656250 42.930000 49.234375 19.750000 31.250000 1856.95s
FLOAT_7_E1 90.630000 88.554688 40.630000 48.429688 15.880000 28.632812 3327.18s
FLOAT_7_E2 91.940000 83.742188 38.530000 50.320312 14.890000 30.359375 3332.99s
FLOAT_7_E3 94.170000 93.312500 44.200000 46.835938 11.800000 12.992188 3340.01s
FLOAT_7_E4 92.950000 90.148438 43.750000 49.507812 14.640000 17.976562 3342.85s
FLOAT_7_E5 88.970000 84.078125 42.870000 47.156250 20.230000 29.546875 3342.01s
FLOAT_8_E1 90.840000 89.453125 39.530000 45.695312 14.220000 24.164062 6245.58s
FLOAT_8_E2 92.650000 85.210938 39.950000 52.820312 13.510000 27.437500 6251.00s
FLOAT_8_E3 94.470000 94.718750 44.390000 46.265625 10.180000 11.757812 6263.01s
FLOAT_8_E4 94.170000 92.882812 44.530000 48.015625 12.000000 14.109375 6269.03s
FLOAT_8_E5 92.950000 90.125000 44.670000 50.742188 14.740000 18.765625 6268.95s
FLOAT_8_E6 87.850000 83.859375 41.850000 43.132812 21.560000 28.687500 6267.85s
VGG_16 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.130000 99.031250 53.170000 51.195312 18.780000 25.054688 28.36s
INT_2 10.000000 10.070312 10.000000 10.070312 10.000000 10.070312 70.63s
INT_3 10.020000 9.812500 10.000000 10.070312 10.000000 10.070312 55.48s
INT_4 29.300000 10.828125 11.970000 11.328125 10.190000 10.593750 63.97s
INT_5 88.810000 92.210938 39.680000 52.656250 20.310000 38.015625 72.48s
INT_6 92.500000 98.500000 50.700000 54.453125 21.590000 33.304688 74.44s
INT_7 92.980000 98.812500 52.910000 52.335938 20.730000 29.117188 72.67s
INT_8 93.020000 98.992188 53.240000 51.328125 19.540000 26.250000 62.34s
INT_9 93.050000 99.070312 53.120000 51.601562 19.020000 25.835938 72.20s
INT_10 93.150000 99.000000 53.180000 51.078125 18.930000 25.390625 73.33s
INT_11 93.110000 99.023438 53.070000 51.085938 18.730000 25.179688 68.53s
INT_12 93.140000 99.031250 53.200000 51.062500 18.720000 25.125000 68.94s
INT_13 93.160000 99.023438 53.210000 51.210938 18.730000 25.125000 71.74s
INT_14 93.160000 99.031250 53.190000 51.265625 18.780000 25.101562 72.25s
INT_15 93.130000 99.031250 53.290000 51.148438 18.820000 25.101562 71.79s
INT_16 93.140000 99.031250 53.160000 51.187500 18.700000 25.132812 61.27s
POT_2 10.000000 10.070312 10.000000 10.070312 10.000000 10.070312 89.14s
POT_3 10.450000 13.343750 10.010000 10.148438 10.010000 10.046875 87.41s
POT_4 79.980000 64.750000 43.280000 32.359375 20.620000 22.156250 105.94s
POT_5 79.820000 64.664062 43.910000 31.320312 20.470000 21.453125 143.33s
POT_6 79.670000 65.164062 42.980000 31.812500 20.350000 22.554688 217.25s
POT_7 79.850000 64.421875 43.180000 31.375000 20.320000 21.734375 367.59s
POT_8 79.790000 64.773438 43.390000 31.101562 20.480000 21.281250 665.74s
FLOAT_3_E1 10.130000 10.070312 10.030000 10.085938 10.010000 10.062500 90.55s
FLOAT_4_E1 80.090000 53.960938 35.250000 32.960938 19.880000 24.148438 106.88s
FLOAT_4_E2 72.050000 83.281250 37.510000 34.007812 21.830000 25.718750 107.78s
FLOAT_5_E1 87.670000 76.468750 45.970000 35.593750 20.450000 23.593750 143.18s
FLOAT_5_E2 90.380000 97.765625 49.290000 43.804688 21.410000 28.507812 143.05s
FLOAT_5_E3 89.850000 95.109375 51.530000 42.296875 21.690000 24.343750 143.16s
FLOAT_6_E1 90.200000 85.960938 48.690000 40.906250 20.800000 25.617188 215.65s
FLOAT_6_E2 91.860000 98.812500 50.450000 45.195312 19.170000 26.992188 215.42s
FLOAT_6_E3 92.750000 98.593750 53.610000 50.125000 20.300000 26.750000 215.43s
FLOAT_6_E4 89.750000 95.078125 51.470000 42.039062 21.660000 24.109375 215.40s
FLOAT_7_E1 90.810000 90.343750 49.430000 41.398438 19.780000 25.335938 365.55s
FLOAT_7_E2 91.920000 98.968750 51.530000 45.648438 18.970000 26.421875 366.54s
FLOAT_7_E3 92.890000 99.023438 52.850000 51.203125 19.150000 25.984375 366.76s
FLOAT_7_E4 92.710000 98.578125 53.240000 50.257812 20.240000 27.101562 367.26s
FLOAT_7_E5 89.770000 95.179688 51.810000 42.375000 21.750000 24.351562 366.76s
FLOAT_8_E1 91.190000 91.710938 49.480000 42.101562 19.400000 25.476562 661.73s
FLOAT_8_E2 92.220000 99.132812 52.180000 47.023438 19.320000 26.281250 663.08s
FLOAT_8_E3 93.150000 99.023438 53.110000 50.234375 19.090000 25.382812 662.49s
FLOAT_8_E4 93.000000 99.007812 53.010000 51.062500 19.200000 25.875000 664.14s
FLOAT_8_E5 92.790000 98.632812 53.290000 49.976562 20.310000 26.875000 664.98s
FLOAT_8_E6 89.750000 95.062500 51.650000 42.023438 21.710000 24.554688 665.24s
VGG_16 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.140000 99.539062 53.180000 49.640625 18.800000 20.265625 28.55s
INT_2 10.000000 10.062500 10.000000 10.062500 10.000000 10.062500 70.01s
INT_3 10.020000 9.390625 10.000000 10.062500 10.000000 10.062500 55.97s
INT_4 29.300000 10.687500 11.750000 10.695312 9.820000 10.117188 69.62s
INT_5 88.550000 86.140625 39.580000 53.320312 19.850000 40.585938 65.74s
INT_6 92.310000 98.867188 50.520000 52.898438 21.360000 28.515625 65.59s
INT_7 92.980000 99.437500 52.860000 51.609375 20.450000 24.734375 72.48s
INT_8 93.130000 99.554688 53.380000 49.750000 19.640000 21.234375 75.11s
INT_9 93.080000 99.554688 53.190000 50.328125 19.190000 21.179688 63.08s
INT_10 93.140000 99.554688 53.380000 49.562500 18.820000 20.500000 72.66s
INT_11 93.120000 99.531250 53.100000 49.734375 18.720000 20.437500 57.33s
INT_12 93.160000 99.539062 53.180000 49.578125 18.690000 20.320312 72.70s
INT_13 93.170000 99.539062 53.140000 49.539062 18.720000 20.281250 55.47s
INT_14 93.150000 99.539062 53.220000 49.625000 18.640000 20.320312 72.86s
INT_15 93.140000 99.539062 53.190000 49.710938 18.670000 20.335938 60.35s
INT_16 93.140000 99.539062 53.170000 49.710938 18.740000 20.304688 74.73s
POT_2 10.000000 10.062500 10.000000 10.062500 10.000000 10.062500 88.77s
POT_3 10.450000 12.125000 10.140000 10.210938 9.960000 9.921875 91.41s
POT_4 79.980000 59.140625 43.350000 27.429688 20.610000 21.804688 108.44s
POT_5 79.780000 57.601562 43.470000 27.398438 20.450000 21.515625 143.89s
POT_6 80.060000 57.820312 43.140000 27.375000 20.040000 21.445312 216.30s
POT_7 79.890000 58.921875 43.630000 27.562500 20.730000 21.757812 366.70s
POT_8 79.900000 57.867188 43.730000 27.406250 20.540000 21.945312 664.48s
FLOAT_3_E1 10.130000 10.054688 10.000000 10.062500 10.010000 10.023438 90.10s
FLOAT_4_E1 80.220000 46.203125 35.740000 31.843750 19.140000 23.343750 104.98s
FLOAT_4_E2 72.180000 85.367188 35.890000 33.085938 21.340000 25.484375 109.12s
FLOAT_5_E1 87.580000 84.609375 46.180000 33.101562 20.860000 21.296875 144.63s
FLOAT_5_E2 90.320000 98.515625 48.540000 36.945312 20.950000 21.679688 145.13s
FLOAT_5_E3 89.790000 97.789062 51.460000 36.906250 21.600000 20.562500 144.24s
FLOAT_6_E1 90.310000 92.906250 48.590000 36.343750 20.680000 21.468750 215.38s
FLOAT_6_E2 91.670000 99.187500 50.740000 40.945312 19.230000 21.367188 216.65s
FLOAT_6_E3 92.800000 99.484375 53.400000 48.804688 20.180000 20.765625 215.16s
FLOAT_6_E4 89.540000 98.109375 51.650000 36.203125 21.940000 20.507812 215.94s
FLOAT_7_E1 90.740000 96.718750 49.670000 36.132812 19.640000 21.085938 365.69s
FLOAT_7_E2 92.000000 99.421875 51.320000 42.093750 19.180000 20.632812 365.91s
FLOAT_7_E3 93.010000 99.468750 52.940000 49.523438 19.250000 21.015625 365.89s
FLOAT_7_E4 92.650000 99.406250 53.010000 48.484375 20.330000 21.015625 366.05s
FLOAT_7_E5 89.570000 97.804688 51.280000 36.648438 21.830000 20.546875 366.57s
FLOAT_8_E1 91.060000 96.914062 49.670000 35.992188 19.690000 20.648438 661.56s
FLOAT_8_E2 92.060000 99.468750 52.110000 43.414062 18.690000 21.046875 661.99s
FLOAT_8_E3 93.190000 99.523438 53.030000 48.750000 19.070000 20.531250 663.80s
FLOAT_8_E4 92.970000 99.523438 53.000000 49.328125 19.200000 21.085938 664.10s
FLOAT_8_E5 92.760000 99.445312 53.290000 48.398438 20.350000 20.992188 664.13s
FLOAT_8_E6 89.740000 97.937500 51.530000 36.359375 21.750000 20.710938 664.38s
VGG_19 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.020000 99.914062 50.590000 60.492188 16.780000 26.593750 50.74s
INT_2 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 102.39s
INT_3 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 102.14s
INT_4 17.330000 22.578125 12.330000 15.132812 9.470000 14.117188 103.49s
INT_5 88.220000 98.562500 36.050000 61.734375 17.140000 41.718750 103.08s
INT_6 92.250000 99.867188 49.620000 69.320312 20.110000 40.828125 93.44s
INT_7 92.760000 99.914062 50.360000 63.726562 18.850000 32.343750 89.96s
INT_8 93.000000 99.921875 50.710000 61.210938 17.760000 28.468750 84.60s
INT_9 93.040000 99.898438 50.460000 60.617188 17.170000 27.273438 101.82s
INT_10 93.060000 99.914062 50.580000 60.523438 16.760000 26.765625 103.82s
INT_11 92.980000 99.921875 50.740000 60.351562 16.920000 26.546875 85.06s
INT_12 93.030000 99.914062 50.580000 60.468750 16.750000 26.625000 84.62s
INT_13 93.010000 99.914062 50.500000 60.523438 16.940000 26.554688 84.16s
INT_14 93.030000 99.914062 50.540000 60.515625 16.870000 26.554688 84.56s
INT_15 93.030000 99.914062 50.540000 60.476562 16.870000 26.562500 104.47s
INT_16 93.030000 99.914062 50.580000 60.437500 16.800000 26.531250 102.85s
POT_2 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 127.08s
POT_3 10.000000 9.679688 10.000000 9.679688 10.000000 9.679688 138.92s
POT_4 71.830000 82.578125 37.830000 24.765625 18.680000 17.468750 165.01s
POT_5 71.960000 81.296875 37.380000 24.375000 18.000000 17.312500 217.42s
POT_6 72.020000 82.164062 37.370000 24.554688 18.310000 17.453125 322.57s
POT_7 71.430000 82.203125 37.540000 24.234375 17.810000 17.039062 537.44s
POT_8 71.450000 81.195312 37.200000 24.437500 18.290000 17.109375 954.10s
FLOAT_3_E1 10.010000 9.679688 9.960000 9.687500 9.970000 9.679688 138.82s
FLOAT_4_E1 77.130000 77.609375 27.980000 43.015625 16.310000 30.054688 163.94s
FLOAT_4_E2 71.290000 94.898438 27.710000 33.773438 18.030000 25.085938 165.68s
FLOAT_5_E1 86.890000 95.406250 42.240000 38.531250 19.310000 23.898438 218.32s
FLOAT_5_E2 88.630000 99.554688 44.110000 47.046875 20.910000 26.898438 219.26s
FLOAT_5_E3 90.500000 99.679688 47.970000 48.367188 19.600000 24.515625 219.31s
FLOAT_6_E1 88.860000 97.664062 44.750000 35.500000 19.350000 20.781250 324.47s
FLOAT_6_E2 91.150000 99.820312 48.270000 52.203125 19.410000 26.687500 324.68s
FLOAT_6_E3 92.420000 99.898438 51.350000 60.164062 18.580000 26.484375 324.80s
FLOAT_6_E4 90.460000 99.710938 47.780000 48.328125 19.350000 24.445312 324.63s
FLOAT_7_E1 89.930000 98.476562 44.670000 35.250000 17.830000 20.281250 537.80s
FLOAT_7_E2 91.910000 99.859375 48.640000 55.484375 19.150000 26.453125 537.25s
FLOAT_7_E3 92.940000 99.914062 50.600000 59.750000 17.260000 27.234375 539.38s
FLOAT_7_E4 92.700000 99.898438 51.310000 60.328125 18.570000 26.500000 539.31s
FLOAT_7_E5 90.600000 99.703125 48.100000 48.070312 19.520000 24.328125 539.27s
FLOAT_8_E1 90.110000 98.507812 45.080000 35.031250 17.500000 19.875000 954.49s
FLOAT_8_E2 92.020000 99.914062 49.220000 55.992188 18.060000 25.960938 952.79s
FLOAT_8_E3 93.100000 99.898438 50.260000 59.765625 17.110000 26.656250 952.70s
FLOAT_8_E4 92.940000 99.906250 50.450000 59.320312 17.310000 27.242188 952.77s
FLOAT_8_E5 92.640000 99.921875 51.410000 60.554688 18.730000 26.437500 954.18s
FLOAT_8_E6 90.790000 99.734375 47.960000 48.148438 19.490000 24.445312 954.13s
VGG_19 cifar10
Title Org_acc Org_gen_acc FGSM_acc FGSM_gen_acc PGD_acc PGD_gen_acc Time
Full 93.030000 96.468750 50.580000 48.289062 16.840000 14.828125 52.77s
INT_2 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 96.00s
INT_3 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 94.59s
INT_4 17.340000 19.406250 12.000000 12.210938 10.190000 11.203125 86.37s
INT_5 88.200000 79.890625 35.510000 37.460938 17.080000 22.085938 95.28s
INT_6 92.270000 93.968750 49.290000 51.601562 20.150000 23.242188 96.17s
INT_7 92.800000 96.117188 50.060000 49.304688 18.910000 18.437500 90.90s
INT_8 92.980000 96.226562 50.590000 48.484375 17.920000 16.695312 90.05s
INT_9 93.040000 96.367188 50.320000 48.421875 17.180000 15.632812 92.23s
INT_10 93.050000 96.453125 50.610000 48.523438 16.900000 15.312500 90.34s
INT_11 93.000000 96.460938 50.580000 48.328125 16.930000 15.031250 90.91s
INT_12 93.030000 96.460938 50.600000 48.390625 16.840000 14.921875 90.62s
INT_13 93.020000 96.460938 50.560000 48.304688 16.840000 14.898438 92.62s
INT_14 93.020000 96.460938 50.510000 48.289062 16.850000 14.906250 91.85s
INT_15 93.030000 96.460938 50.550000 48.226562 16.820000 14.890625 90.73s
INT_16 93.020000 96.468750 50.640000 48.250000 16.730000 14.929688 93.51s
POT_2 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 131.40s
POT_3 10.000000 9.945312 10.000000 9.945312 10.000000 9.945312 142.94s
POT_4 71.750000 51.281250 37.890000 26.898438 18.670000 18.296875 169.33s
POT_5 71.750000 50.445312 36.830000 25.984375 18.010000 17.914062 221.88s
POT_6 71.900000 51.773438 37.120000 26.546875 18.570000 18.000000 325.98s
POT_7 71.420000 52.296875 37.100000 26.640625 18.220000 17.828125 540.99s
POT_8 71.330000 51.046875 37.440000 26.000000 18.410000 17.500000 955.80s
FLOAT_3_E1 10.000000 9.953125 10.070000 9.960938 10.010000 9.953125 139.87s
FLOAT_4_E1 77.180000 53.250000 26.920000 36.937500 15.590000 26.500000 167.38s
FLOAT_4_E2 71.290000 80.570312 28.350000 31.726562 17.350000 23.281250 166.30s
FLOAT_5_E1 86.940000 76.109375 42.550000 39.476562 19.490000 24.515625 219.69s
FLOAT_5_E2 88.600000 92.351562 44.490000 41.062500 21.190000 18.078125 219.69s
FLOAT_5_E3 90.470000 95.218750 47.770000 41.828125 19.290000 18.851562 220.72s
FLOAT_6_E1 88.850000 85.789062 44.830000 38.187500 19.830000 22.335938 325.89s
FLOAT_6_E2 91.160000 93.945312 48.750000 45.328125 19.660000 19.773438 325.96s
FLOAT_6_E3 92.440000 96.523438 51.350000 47.250000 18.790000 12.625000 325.88s
FLOAT_6_E4 90.540000 95.109375 48.140000 41.835938 19.490000 18.242188 325.96s
FLOAT_7_E1 89.910000 87.546875 44.600000 38.703125 17.840000 22.023438 540.81s
FLOAT_7_E2 91.930000 95.109375 49.150000 46.820312 19.320000 19.820312 540.80s
FLOAT_7_E3 92.920000 96.328125 50.620000 48.382812 17.310000 15.632812 540.87s
FLOAT_7_E4 92.700000 96.546875 51.260000 47.156250 18.720000 12.664062 540.89s
FLOAT_7_E5 90.580000 95.226562 47.660000 41.632812 19.500000 18.468750 540.80s
FLOAT_8_E1 90.100000 87.765625 45.000000 38.296875 17.510000 21.710938 955.80s
FLOAT_8_E2 92.040000 95.437500 49.610000 47.187500 18.310000 19.351562 955.09s
FLOAT_8_E3 93.090000 96.468750 50.520000 47.914062 16.990000 15.812500 954.98s
FLOAT_8_E4 92.920000 96.375000 50.560000 48.312500 17.400000 15.710938 955.04s
FLOAT_8_E5 92.620000 96.703125 51.200000 47.195312 18.730000 12.593750 955.57s
FLOAT_8_E6 90.770000 94.867188 47.870000 41.742188 19.570000 18.664062 954.81s
...@@ -5,5 +5,15 @@ for name in $name_list; do ...@@ -5,5 +5,15 @@ for name in $name_list; do
if [ ! -d "ret_one/$name" ]; then if [ ! -d "ret_one/$name" ]; then
mkdir -p "ret_one/$name" mkdir -p "ret_one/$name"
fi fi
sbatch --job-name=$name -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" --export=Model=$name,Dataset=cifar10 robust_one.slurm if [ "$name" == "ResNet_152" ] ; then
TimeLen="3-00:00:00"
QosType="gpu-long"
else
TimeLen="1-06:00:00"
QosType="gpu-normal"
fi
adjust="--adjust"
sbatch --job-name=$name -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$name,Dataset=cifar10,Adjust=$adjust robust_one.slurm
adjust=""
sbatch --job-name=$name -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$name,Dataset=cifar10,Adjust=$adjust robust_one.slurm
done done
\ No newline at end of file
...@@ -5,5 +5,15 @@ for name in $name_list; do ...@@ -5,5 +5,15 @@ for name in $name_list; do
if [ ! -d "ret_one/$name" ]; then if [ ! -d "ret_one/$name" ]; then
mkdir -p "ret_one/$name" mkdir -p "ret_one/$name"
fi fi
sbatch --job-name=$name -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" --export=Model=$name,Dataset=cifar100 robust_one.slurm if [ "$name" == "ResNet_152" ] ; then
TimeLen="3-00:00:00"
QosType="gpu-long"
else
TimeLen="1-06:00:00"
QosType="gpu-normal"
fi
adjust="--adjust"
sbatch --job-name=$name -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$name,Dataset=cifar100,Adjust=$adjust robust_one.slurm
adjust=""
sbatch --job-name=$name -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$name,Dataset=cifar100,Adjust=$adjust robust_one.slurm
done done
\ No newline at end of file
...@@ -3,4 +3,15 @@ if [ ! -d "ret_one/$1" ]; then ...@@ -3,4 +3,15 @@ if [ ! -d "ret_one/$1" ]; then
mkdir -p "ret_one/$1" mkdir -p "ret_one/$1"
fi fi
sbatch --job-name=$1 -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" --export=Model=$1,Dataset=cifar10 robust_one.slurm if [ "$1" == "ResNet_152" ] ; then
TimeLen="3-00:00:00"
QosType="gpu-long"
else
TimeLen="1-06:00:00"
QosType="gpu-normal"
fi
adjust="--adjust"
sbatch --job-name=$1 -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$1,Dataset=cifar10,Adjust=$adjust robust_one.slurm
adjust=""
sbatch --job-name=$1 -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$1,Dataset=cifar10,Adjust=$adjust robust_one.slurm
\ No newline at end of file
...@@ -3,4 +3,15 @@ if [ ! -d "ret_one/$1" ]; then ...@@ -3,4 +3,15 @@ if [ ! -d "ret_one/$1" ]; then
mkdir -p "ret_one/$1" mkdir -p "ret_one/$1"
fi fi
sbatch --job-name=$1 -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" --export=Model=$1,Dataset=cifar100 robust_one.slurm if [ "$1" == "ResNet_152" ] ; then
TimeLen="3-00:00:00"
QosType="gpu-long"
else
TimeLen="1-06:00:00"
QosType="gpu-normal"
fi
adjust="--adjust"
sbatch --job-name=$1 -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$1,Dataset=cifar100,Adjust=$adjust robust_one.slurm
adjust=""
sbatch --job-name=$1 -o "ret_one/%x/%j.out" -e "ret_one/%x/%j.err" -t $TimeLen --qos=$QosType --export=Model=$1,Dataset=cifar100,Adjust=$adjust robust_one.slurm
\ No newline at end of file
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment